Apr 02 05:50:17.771087 np0000162743 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service.
Apr 02 05:50:19.046822 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.common.config [-] Logging enabled!
Apr 02 05:50:19.047431 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev85
Apr 02 05:50:19.047431 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103588) setup_logging /opt/stack/neutron/neutron/common/config.py:124}}
Apr 02 05:50:19.047431 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting...
Apr 02 05:50:19.047431 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 05:50:19.047652 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 05:50:19.047652 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 05:50:19.047652 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 05:50:19.047652 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 05:50:19.047877 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [-] Loading core plugin: ml2
Apr 02 05:50:19.308262 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.308262 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.308262 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.309013 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.309105 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.309163 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.343088 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.343241 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.343241 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.349447 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.349546 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.349546 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.480409 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.480602 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.480602 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.481001 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.481094 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.481170 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.540513 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x77e0a25031a0> agent after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.540677 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x77e0a25031a0> agent after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.540677 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x77e0a2503240> segment precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.540677 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x77e0a25032e0> network precommit_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.540936 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x77e0a2530540> segment before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.589880 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> network before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.589880 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x77e0a24ed620> agent before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.589880 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> network before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590186 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> port before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590186 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> port before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590186 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> segment precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590186 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> segment precommit_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590186 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> segment after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> segment after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> network after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> network precommit_delete 0, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> port provisioning_complete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> agent after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> subnet after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> subnet precommit_delete 0, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.590907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> segment_host_mapping after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin.delete_agent_notified of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> agent after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591559 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x77e0a37bee40>> rbac-policy before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.591559 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591559 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591559 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591774 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591774 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591774 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:19.591936 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve']
Apr 02 05:50:19.592546 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public']
Apr 02 05:50:19.593091 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Apr 02 05:50:19.593631 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]})
Apr 02 05:50:19.593857 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan']
Apr 02 05:50:19.593857 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan'])
Apr 02 05:50:19.593971 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve']
Apr 02 05:50:19.594029 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos']
Apr 02 05:50:19.594514 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos']
Apr 02 05:50:19.594599 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos']
Apr 02 05:50:19.594673 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn']
Apr 02 05:50:19.629304 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn']
Apr 02 05:50:19.629419 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn']
Apr 02 05:50:19.629419 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling.
Apr 02 05:50:19.629932 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x77e0a2167140>> floatingip before_response 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.630021 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x77e0a2167140>> port before_response 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:19.653798 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Apr 02 05:50:19.653874 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Apr 02 05:50:19.653874 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Apr 02 05:50:19.654006 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)]
Apr 02 05:50:19.697906 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO dbcounter [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Registered counter for database neutron
Apr 02 05:50:19.712762 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_db.sqlalchemy.engines [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103588) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 05:50:20.096180 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG dbcounter [-] [103588] Writer thread running {{(pid=103588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 02 05:50:20.272676 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing driver for type 'local'
Apr 02 05:50:20.272859 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing driver for type 'vlan'
Apr 02 05:50:20.386419 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] VlanTypeDriver initialization complete
Apr 02 05:50:20.386419 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing extension driver 'port_security'
Apr 02 05:50:20.386560 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.extensions.port_security [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] PortSecurityExtensionDriver initialization complete
Apr 02 05:50:20.386589 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing extension driver 'qos'
Apr 02 05:50:20.386671 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.plugins.ml2.extensions.qos [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QosExtensionDriver initialization complete {{(pid=103588) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}}
Apr 02 05:50:20.386750 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing mechanism driver 'ovn'
Apr 02 05:50:20.386818 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Starting OVNMechanismDriver
Apr 02 05:50:20.388159 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver.pre_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> process before_spawn 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388283 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver.post_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> process after_init 55550000, True {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388375 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._add_segment_host_mapping_for_segment of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> segment after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388456 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver.create_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> segment after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388550 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver.delete_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> segment after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388627 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._validate_allowed_address_pairs of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> allowed_address_pair before_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388712 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._create_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388799 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._update_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388880 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._create_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.388964 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group precommit_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389070 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389170 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._create_sg_rule_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group_rule precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389253 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group_rule after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389359 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> security_group_rule before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389440 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> address_group after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389526 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> address_group after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389608 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x77e0a2251f70>> address_group after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389768 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.ovn.driver.OVNQosDriver object at 0x77e0a1f065d0>> qos_plugin after_init 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.389909 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNTrunkDriver.register of <neutron.services.trunk.drivers.ovn.trunk_driver.OVNTrunkDriver object at 0x77e0a1ecdbe0>> trunk_plugin after_init 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.390093 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.ovn.driver.OVNDriver object at 0x77e0a0be0d10>> logging-plugin after_init 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.390471 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.services.logapi.drivers.ovn.driver [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVN logging driver registered
Apr 02 05:50:20.391622 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.plugins.ml2.plugin [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103588) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 02 05:50:20.391825 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0f80>> port after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.391913 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0f80>> port after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392035 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0f80>> port after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392117 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ef0>> subnet after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392200 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ef0>> subnet after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392303 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ef0>> subnet after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392367 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e90>> network after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392460 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e90>> network after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392539 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e90>> network after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392617 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e60>> security_group after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392697 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e60>> security_group after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392774 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0e60>> security_group after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392853 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ec0>> security_group_rule after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.392933 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ec0>> security_group_rule after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.393012 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0ec0>> security_group_rule after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.393093 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0dd0>> address_group after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.393175 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0dd0>> address_group after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.393233 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x77e0a0be0dd0>> address_group after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.393355 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ML2 OVO RPC backend initialized. {{(pid=103588) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}}
Apr 02 05:50:20.393962 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.quota [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded quota_driver: <neutron.db.quota.driver_nolock.DbQuotaNoLockDriver object at 0x77e0a0be0da0>.
Apr 02 05:50:20.394052 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.plugin [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Modular L2 Plugin initialization complete
Apr 02 05:50:20.394158 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading services supported by the core plugin {{(pid=103588) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:170}}
Apr 02 05:50:20.394238 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.plugins.ml2.managers [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Got port-security extension from driver 'port_security'
Apr 02 05:50:20.394487 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103588) _load_service_plugins /opt/stack/neutron/neutron/manager.py:195}}
Apr 02 05:50:20.394552 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: ovn-router
Apr 02 05:50:20.401580 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._delete_router_remove_external_gateways of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> router before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.401713 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x77e0a236fec0> port after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.401789 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x77e0a236fd80> port after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.401868 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x77e0a236fe20> subnet after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.401950 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x77e0a236ff60> subnetpool_address_scope after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402048 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x77e0a07025c0> port before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402117 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x77e0a07025c0> port after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402196 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> port precommit_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402294 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip at 0x77e0a2357e20> port before_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402374 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x77e0a2357d80> port before_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402455 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> router precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402536 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> router precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> router precommit_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.402700 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function OVNL3RouterPlugin._subnet_update at 0x77e0a0702520> subnet after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.403298 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Tracking information for resource: router configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:20.403359 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.quota.resource_registry [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Tracking information for resource: floatingip configured {{(pid=103588) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Apr 02 05:50:20.403438 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.services.ovn_l3.plugin [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Starting OVNL3RouterPlugin
Apr 02 05:50:20.403603 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNPortForwarding.register of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> port_forwarding_plugin after_init 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.403763 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77e0a0be3d40>> router before_create 55550100, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.403831 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77e0a0be3d40>> router precommit_delete 55550100, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.403935 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77e0a0be3d40>> router precommit_create 55550100, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.404010 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x77e0a0be3d40>> router precommit_update 55550100, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.406416 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.services.provider_configuration [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Service providers = [] {{(pid=103588) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:170}}
Apr 02 05:50:20.406486 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.db.servicetype_db [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103588) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Apr 02 05:50:20.407505 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVN_L3_HA_db_mixin._precommit_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router precommit_create 55549900, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407592 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_add_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router_interface after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407673 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407741 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407796 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip precommit_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407888 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.407990 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_status_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip after_status_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408064 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_floatingip_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> floatingip after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408140 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_portforwarding_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> port_forwarding after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408403 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_remove_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router_interface after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408403 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router after_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408403 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_router_create_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_router_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router after_delete 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OvnDriver._process_router_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x77e0a0be2bd0>> router after_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.services.service_base [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=103588) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Apr 02 05:50:20.408784 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <bound method OVNL3RouterPlugin._post_fork_initialize of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x77e0a0731f40>> process after_init 55550001, True {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.408784 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.408901 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: auto_allocate
Apr 02 05:50:20.409574 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x77e0a06b4900> network precommit_update 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.409651 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron_lib.callbacks.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x77e0a06b4900> network precommit_create 55550000, False {{(pid=103588) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.409845 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.409937 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: tag
Apr 02 05:50:20.412164 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.412242 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: timestamp
Apr 02 05:50:20.413173 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.413261 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: network_ip_availability
Apr 02 05:50:20.414398 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.414478 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: flavors
Apr 02 05:50:20.415185 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.415253 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading Plugin: revisions
Apr 02 05:50:20.416047 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.manager [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103588) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}}
Apr 02 05:50:20.416134 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_concurrency.lockutils [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.368s {{(pid=103588) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 05:50:20.416317 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=103588) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}}
Apr 02 05:50:20.416386 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Initializing extension manager.
Apr 02 05:50:20.416605 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: __init__.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.416682 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: __pycache__ {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.416740 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: address_group.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.417013 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.417188 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: address-group
Apr 02 05:50:20.417255 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: address_scope.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.417522 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.417719 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: address-scope
Apr 02 05:50:20.417719 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: admin_state_down_before_update.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.417918 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.418055 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins
Apr 02 05:50:20.418114 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: agent.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.418382 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.418512 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: agent
Apr 02 05:50:20.418569 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: agent_resources_synced.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.418759 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.418896 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension agent-resources-synced not supported by any of loaded plugins
Apr 02 05:50:20.418958 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: allowedaddresspairs.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.419498 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.419641 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: allowed-address-pairs
Apr 02 05:50:20.419704 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: auto_allocated_topology.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.419906 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.420049 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: auto-allocated-topology
Apr 02 05:50:20.420110 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: availability_zone.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.420361 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.420479 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: availability_zone
Apr 02 05:50:20.420537 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: availability_zone_filter.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.420734 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.420859 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension availability_zone_filter not supported by any of loaded plugins
Apr 02 05:50:20.420918 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: data_plane_status.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.421118 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.421243 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension data-plane-status not supported by any of loaded plugins
Apr 02 05:50:20.421490 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: default_subnetpools.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.421490 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.421627 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: default-subnetpools
Apr 02 05:50:20.421687 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: dhcpagentscheduler.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.421980 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.422116 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: dhcp_agent_scheduler
Apr 02 05:50:20.422175 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: dns.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.422379 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.422511 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: dns-integration
Apr 02 05:50:20.422586 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: dns_domain_ports.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.422758 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.422944 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: dns-domain-ports
Apr 02 05:50:20.422944 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.423159 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like <project_id>, <project_name>, <user_id> and <user_name> as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.423326 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: dns-integration-domain-keywords
Apr 02 05:50:20.423401 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: dvr.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.423568 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.423700 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension dvr not supported by any of loaded plugins
Apr 02 05:50:20.423765 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: ecmp_routes.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.423941 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.424135 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension ecmp_routes not supported by any of loaded plugins
Apr 02 05:50:20.424213 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: empty_string_filtering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.424389 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.424519 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: empty-string-filtering
Apr 02 05:50:20.424582 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.424760 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.424889 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Apr 02 05:50:20.424953 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.425129 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.425273 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Apr 02 05:50:20.425349 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: external_net.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.425525 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.425654 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: external-net
Apr 02 05:50:20.425723 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: extra_dhcp_opt.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.425896 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.426028 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: extra_dhcp_opt
Apr 02 05:50:20.426098 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: extraroute.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.426291 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.426425 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: extraroute
Apr 02 05:50:20.426495 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: extraroute_atomic.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.426684 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.426818 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: extraroute-atomic
Apr 02 05:50:20.426887 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: filter_validation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.427079 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.427214 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: filter-validation
Apr 02 05:50:20.427301 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: fip_pf_description.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.427479 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.427610 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Apr 02 05:50:20.427679 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: fip_pf_detail.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.427855 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.427999 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: floating-ip-port-forwarding-detail
Apr 02 05:50:20.428069 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: fip_pf_port_range.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.428242 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.428389 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins
Apr 02 05:50:20.428459 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: fip_port_details.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.428737 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.428876 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: fip-port-details
Apr 02 05:50:20.428947 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: flavors.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.429142 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.429279 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: flavors
Apr 02 05:50:20.429360 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.429601 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.429726 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Apr 02 05:50:20.429796 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: floatingip_pools.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.430011 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.430139 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: floatingip-pools
Apr 02 05:50:20.430209 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: ip_allocation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.430402 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.430532 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension ip_allocation not supported by any of loaded plugins
Apr 02 05:50:20.430602 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.430777 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.430906 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension ip-substring-filtering not supported by any of loaded plugins
Apr 02 05:50:20.430975 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l2_adjacency.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.431152 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.431300 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l2_adjacency not supported by any of loaded plugins
Apr 02 05:50:20.431372 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.431686 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.431825 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: router
Apr 02 05:50:20.431888 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_conntrack_helper.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.432375 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.432516 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Apr 02 05:50:20.432584 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.432780 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.432924 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: enable-default-route-bfd
Apr 02 05:50:20.432982 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.433176 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.433326 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: enable-default-route-ecmp
Apr 02 05:50:20.433392 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.433570 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.433702 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: ext-gw-mode
Apr 02 05:50:20.433771 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.433945 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.434085 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: l3-ha
Apr 02 05:50:20.434149 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.434338 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.434464 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins
Apr 02 05:50:20.434534 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_extra_gws.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.434708 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.434838 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: external-gateway-multihoming
Apr 02 05:50:20.434908 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_flavors.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.435086 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.435215 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: l3-flavors
Apr 02 05:50:20.435300 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_ndp_proxy.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.435531 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.435657 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l3-ndp-proxy not supported by any of loaded plugins
Apr 02 05:50:20.435727 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.435903 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.436069 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins
Apr 02 05:50:20.436136 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: l3agentscheduler.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.436589 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.436723 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension l3_agent_scheduler not supported by any of loaded plugins
Apr 02 05:50:20.436795 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: local_ip.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.437044 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.437179 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension local_ip not supported by any of loaded plugins
Apr 02 05:50:20.437244 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: logging.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.437503 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.437629 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension logging not supported by any of loaded plugins
Apr 02 05:50:20.437699 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: metering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.438053 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.438190 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension metering not supported by any of loaded plugins
Apr 02 05:50:20.438246 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.438468 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.438601 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins
Apr 02 05:50:20.438666 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: multiprovidernet.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.438849 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.438977 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: multi-provider
Apr 02 05:50:20.439051 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: netmtu.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.439233 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.439372 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: net-mtu
Apr 02 05:50:20.439443 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: netmtu_writable.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.439618 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.439749 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: net-mtu-writable
Apr 02 05:50:20.439819 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: network_availability_zone.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.440044 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.440170 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: network_availability_zone
Apr 02 05:50:20.440241 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: network_ha.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.440436 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.440568 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension network_ha not supported by any of loaded plugins
Apr 02 05:50:20.440640 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: network_ip_availability.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.440827 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.440960 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: network-ip-availability
Apr 02 05:50:20.441033 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: network_ip_availability_details.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.441224 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.441378 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: network-ip-availability-details
Apr 02 05:50:20.441447 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: network_segment_range.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.441690 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.441820 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension network-segment-range not supported by any of loaded plugins
Apr 02 05:50:20.441889 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: pagination.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.442068 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.442151 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: pagination
Apr 02 05:50:20.442208 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_device_profile.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.442397 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.442529 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: port-device-profile
Apr 02 05:50:20.442598 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_hardware_offload_type.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.442769 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.442901 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-hardware-offload-type not supported by any of loaded plugins
Apr 02 05:50:20.442969 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.443143 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.443278 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins
Apr 02 05:50:20.443361 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_hints.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.443536 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.443665 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-hints not supported by any of loaded plugins
Apr 02 05:50:20.443735 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_mac_address_override.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.443908 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.444126 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-mac-override not supported by any of loaded plugins
Apr 02 05:50:20.444207 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.444410 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.444542 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: port-mac-address-regenerate
Apr 02 05:50:20.444612 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.444784 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.444915 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: port-numa-affinity-policy
Apr 02 05:50:20.444984 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.445155 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.445302 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: port-numa-affinity-policy-socket
Apr 02 05:50:20.445373 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_resource_request.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.445542 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.445671 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-resource-request not supported by any of loaded plugins
Apr 02 05:50:20.445739 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_resource_request_groups.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.445917 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.446053 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-resource-request-groups not supported by any of loaded plugins
Apr 02 05:50:20.446123 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: port_trusted_vif.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.446322 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.446485 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-trusted-vif not supported by any of loaded plugins
Apr 02 05:50:20.446525 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: portbindings.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.446690 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.446818 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: binding
Apr 02 05:50:20.446887 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: portbindings_extended.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.447084 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.447214 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: binding-extended
Apr 02 05:50:20.447300 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: portsecurity.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.447473 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.447604 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: port-security
Apr 02 05:50:20.447674 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: project_id.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.447855 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.447912 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: project-id
Apr 02 05:50:20.448085 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: providernet.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.448254 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.448404 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: provider
Apr 02 05:50:20.448473 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qinq.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.448664 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.448795 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: qinq
Apr 02 05:50:20.448864 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.449537 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.449671 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos not supported by any of loaded plugins
Apr 02 05:50:20.449744 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.449947 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.450080 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Apr 02 05:50:20.450146 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.450342 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.450473 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Apr 02 05:50:20.450544 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_default.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.450718 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.450848 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-default not supported by any of loaded plugins
Apr 02 05:50:20.450917 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_fip.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.451087 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.451218 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-fip not supported by any of loaded plugins
Apr 02 05:50:20.451303 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_fip_network_policy.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.451477 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.451606 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-fip-network-policy not supported by any of loaded plugins
Apr 02 05:50:20.451676 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_gateway_ip.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.451845 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.451999 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-gateway-ip not supported by any of loaded plugins
Apr 02 05:50:20.452070 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_port_network_policy.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.452233 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.452380 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-port-network-policy not supported by any of loaded plugins
Apr 02 05:50:20.452449 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.452632 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.452761 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-pps-minimum not supported by any of loaded plugins
Apr 02 05:50:20.452829 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.453011 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.453143 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins
Apr 02 05:50:20.453210 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_pps_rule.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.453415 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.453538 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-pps not supported by any of loaded plugins
Apr 02 05:50:20.453606 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_rule_type_details.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.453776 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.453904 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-rule-type-details not supported by any of loaded plugins
Apr 02 05:50:20.453974 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_rule_type_filter.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.454146 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.454288 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-rule-type-filter not supported by any of loaded plugins
Apr 02 05:50:20.454360 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: qos_rules_alias.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.454541 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.454669 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension qos-rules-alias not supported by any of loaded plugins
Apr 02 05:50:20.454738 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: quota_check_limit.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.454909 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.455038 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: quota-check-limit
Apr 02 05:50:20.455106 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: quota_check_limit_default.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.455314 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.455445 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: quota-check-limit-default
Apr 02 05:50:20.455514 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: quotasv2.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.456008 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.456085 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: quotas
Apr 02 05:50:20.456157 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: quotasv2_detail.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.456434 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.456508 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: quota_details
Apr 02 05:50:20.456578 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: rbac.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.456937 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.457078 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: rbac-policies
Apr 02 05:50:20.457151 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: rbac_address_group.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.457353 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.457489 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension rbac-address-group not supported by any of loaded plugins
Apr 02 05:50:20.457554 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: rbac_address_scope.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.457735 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.457867 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: rbac-address-scope
Apr 02 05:50:20.457936 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: rbac_security_groups.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.458107 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.458238 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: rbac-security-groups
Apr 02 05:50:20.458323 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: rbac_subnetpool.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.458494 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.458641 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension rbac-subnetpool not supported by any of loaded plugins
Apr 02 05:50:20.458701 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: revisionifmatch.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.459071 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.459071 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: revision-if-match
Apr 02 05:50:20.459071 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: revisions.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.459250 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.459401 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: standard-attr-revisions
Apr 02 05:50:20.459467 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: router_availability_zone.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.459662 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.459794 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: router_availability_zone
Apr 02 05:50:20.459864 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: router_enable_snat.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.460053 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.460186 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: router-enable-snat
Apr 02 05:50:20.460255 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: routerservicetype.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.460453 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.460583 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension router-service-type not supported by any of loaded plugins
Apr 02 05:50:20.460651 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_default_rules.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.460980 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.461123 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-groups-default-rules
Apr 02 05:50:20.461171 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.461384 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.461511 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-groups-normalized-cidr
Apr 02 05:50:20.461578 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_port_filtering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.461749 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.461885 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension port-security-groups-filtering not supported by any of loaded plugins
Apr 02 05:50:20.461952 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.462138 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.462274 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-groups-remote-address-group
Apr 02 05:50:20.462350 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.462527 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.462660 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-groups-rules-belongs-to-default-sg
Apr 02 05:50:20.462730 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.462907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.463039 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-groups-shared-filtering
Apr 02 05:50:20.463107 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: securitygroup.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.464467 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.464602 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: security-group
Apr 02 05:50:20.464669 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: segment.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.464926 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.465053 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension segment not supported by any of loaded plugins
Apr 02 05:50:20.465120 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.465322 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.465449 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Apr 02 05:50:20.465516 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: servicetype.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.465713 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.465843 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: service-type
Apr 02 05:50:20.465906 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: sorting.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.466107 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.466173 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: sorting
Apr 02 05:50:20.466237 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: standard_attr_segment.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.466424 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.466544 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension standard-attr-segment not supported by any of loaded plugins
Apr 02 05:50:20.466613 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: standardattrdescription.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.466806 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.466936 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: standard-attr-description
Apr 02 05:50:20.466994 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: stateful_security_group.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.467175 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.467327 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: stateful-security-group
Apr 02 05:50:20.467385 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: stdattrs_common.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.467545 np0000162743 neutron-ovn-maintenance-worker[103588]: WARNING neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Apr 02 05:50:20.467603 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.467785 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.467918 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: subnet-dns-publish-fixed-ip
Apr 02 05:50:20.468023 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnet_external_network.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.468182 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.468332 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: subnet-external-network
Apr 02 05:50:20.468391 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnet_onboard.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.468695 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.468840 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension subnet_onboard not supported by any of loaded plugins
Apr 02 05:50:20.468903 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.469087 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.469223 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Apr 02 05:50:20.469298 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnet_service_types.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.469489 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.469617 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: subnet-service-types
Apr 02 05:50:20.469674 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnetallocation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.469876 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.470005 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: subnet_allocation
Apr 02 05:50:20.470065 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.470260 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.470414 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: subnetpool-prefix-ops
Apr 02 05:50:20.470494 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: tag_creation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.470653 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.470782 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: tag-creation
Apr 02 05:50:20.470844 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.471025 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.471156 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Apr 02 05:50:20.471221 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: tagging.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.471761 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.471898 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: standard-attr-tag
Apr 02 05:50:20.471957 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: timestamp.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.472211 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.472360 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: standard-attr-timestamp
Apr 02 05:50:20.472420 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: trunk.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.472620 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.472750 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension trunk not supported by any of loaded plugins
Apr 02 05:50:20.472807 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: trunk_details.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.472998 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.473123 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension trunk-details not supported by any of loaded plugins
Apr 02 05:50:20.473180 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: uplink_status_propagation.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.473394 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.473517 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension uplink-status-propagation not supported by any of loaded plugins
Apr 02 05:50:20.473574 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.473757 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.473885 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins
Apr 02 05:50:20.473958 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loading extension file: vlantransparent.py {{(pid=103588) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Apr 02 05:50:20.474139 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103588) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Apr 02 05:50:20.474282 np0000162743 neutron-ovn-maintenance-worker[103588]: INFO neutron.api.extensions [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Loaded extension: vlan-transparent
Apr 02 05:50:20.476368 np0000162743 neutron-ovn-maintenance-worker[103588]: WARNING oslo_service.backend._threading.service [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback.
Apr 02 05:50:20.476639 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Full set of CONF: {{(pid=103588) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}}
Apr 02 05:50:20.476715 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ******************************************************************************** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 02 05:50:20.476771 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Configuration options gathered from: {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 02 05:50:20.476827 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 02 05:50:20.476921 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 02 05:50:20.476981 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ================================================================================ {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 02 05:50:20.477089 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] agent_down_time                = 75 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477178 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] allow_automatic_dhcp_failover  = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477258 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] allow_bulk                     = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477444 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477512 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] api_extensions_path            =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477614 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] api_paste_config               = api-paste.ini {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477687 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] api_workers                    = 4 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477784 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] auth_strategy                  = keystone {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477869 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] backlog                        = 4096 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.477952 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] base_mac                       = fa:16:3e:00:00:00 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478055 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] bind_host                      = 0.0.0.0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478143 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] bind_port                      = 9696 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478220 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] client_socket_timeout          = 900 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478335 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] config_dir                     = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478410 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478467 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] config_source                  = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478566 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] control_exchange               = neutron {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478652 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] core_plugin                    = ml2 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478739 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] debug                          = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478825 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] default_availability_zones     = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.478973 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479093 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dhcp_agent_notification        = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479155 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dhcp_agents_per_network        = 1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479208 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dhcp_lease_duration            = 86400 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479314 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dhcp_load_type                 = networks {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479401 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dns_domain                     = openstacklocal {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479488 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479578 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_default_route_bfd       = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479656 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_default_route_ecmp      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479734 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_dvr                     = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479821 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_new_agents              = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479904 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_services_on_agents_with_admin_state_down = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.479987 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_snat_by_default         = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480088 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] enable_traditional_dhcp        = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480178 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] external_dns_driver            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480245 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] filter_validation              = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480365 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] global_physnet_mtu             = 1430 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480439 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] graceful_shutdown_timeout      = 60 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480549 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] host                           = np0000162743 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480633 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] host_dvr_for_dhcp              = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480715 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] http_retries                   = 3 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480802 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] instance_format                = [instance: %(uuid)s]  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480891 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.480972 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ipam_driver                    = internal {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481056 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ipv6_pd_enabled                = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481124 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] l3_ha                          = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481225 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481325 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] l3_ha_network_physical_name    =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481420 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] l3_ha_network_type             =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481530 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_color                      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481587 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_config_append              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481674 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481766 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_dir                        = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481835 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_file                       = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481889 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_options                    = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.481977 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_rotate_interval            = 1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482062 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_rotate_interval_type       = days {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482147 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] log_rotation_type              = none {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482203 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482257 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482356 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482458 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482516 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482595 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_allowed_address_pair       = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482660 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_dns_nameservers            = 5 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482758 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_header_line                = 16384 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482840 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_l3_agents_per_router       = 3 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.482931 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_logfile_count              = 30 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483001 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_logfile_size_mb            = 200 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483068 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_routes                     = 30 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483164 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] max_subnet_host_routes         = 20 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483245 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] my_ip                          = 199.19.213.12 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483348 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe76:b894 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483421 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_auto_schedule          = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483509 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_link_prefix            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483596 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483670 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] notify_nova_on_port_data_changes = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483763 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] notify_nova_on_port_status_changes = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483848 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] pagination_max_limit           = -1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.483926 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] periodic_fuzzy_delay           = 5 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484028 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] periodic_interval              = 40 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484109 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] publish_errors                 = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484191 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rate_limit_burst               = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484319 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rate_limit_except_level        = CRITICAL {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484395 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rate_limit_interval            = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484453 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] retry_until_window             = 30 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484543 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] router_distributed             = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484622 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rpc_resources_processing_step  = 20 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484689 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rpc_response_max_timeout       = 600 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484784 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rpc_response_timeout           = 60 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484864 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rpc_state_report_workers       = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.484947 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] rpc_workers                    = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485014 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] send_events_interval           = 2 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485116 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] service_plugins                = ['ovn-router'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485197 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] setproctitle                   = on {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485291 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] shell_completion               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485386 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] state_path                     = /opt/stack/data/neutron {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485457 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] syslog_log_facility            = LOG_USER {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485553 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] tcp_keepidle                   = 600 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485634 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] transport_url                  = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485706 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] use_journal                    = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485800 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] use_json                       = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485877 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] use_ssl                        = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.485957 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] use_stderr                     = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486043 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] use_syslog                     = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486121 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] vlan_qinq                      = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486199 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] vlan_transparent               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486284 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] wsgi_default_pool_size         = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486381 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] wsgi_keep_alive                = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486464 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486539 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] wsgi_server_debug              = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.486643 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_concurrency.disable_process_locking = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.486739 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.486836 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.connection_string     = messaging:// {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.486938 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.enabled               = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487013 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.es_doc_type           = notification {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487098 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.es_scroll_size        = 10000 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487191 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.es_scroll_time        = 2m {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487285 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.filter_error_trace    = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487380 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.hmac_keys             = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487467 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.sentinel_service_name = mymaster {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487561 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.socket_timeout        = 0.1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487647 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.trace_requests        = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487732 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler.trace_sqlalchemy      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487826 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler_jaeger.process_tags   = {} {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.487911 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler_jaeger.service_name_prefix = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488032 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] profiler_otlp.service_name_prefix = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488119 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488204 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488311 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488396 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488469 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488578 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.enforce_new_defaults = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488756 np0000162743 neutron-ovn-maintenance-worker[103588]: WARNING oslo_config.cfg [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 02 05:50:20.488853 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.enforce_scope      = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.488943 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.policy_default_rule = default {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489012 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489112 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489202 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489304 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489391 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489474 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489557 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489646 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489741 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489830 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] service_providers.service_provider = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.489923 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.auth_section              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490089 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.auth_type                 = password {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490089 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.auth_url                  = https://199.19.213.12/identity {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490168 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.cafile                    = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490260 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.certfile                  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490364 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.collect_timing            = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490450 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.default_domain_id         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490534 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.default_domain_name       = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.domain_id                 = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490698 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.domain_name               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490788 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.endpoint_type             = public {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490875 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.insecure                  = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.490959 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.keyfile                   = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491046 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.password                  = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491130 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.project_domain_id         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491217 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.project_domain_name       = Default {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491323 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.project_id                = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491411 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.project_name              = service {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491499 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.region_name               = RegionOne {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491587 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.split_loggers             = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491669 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.system_scope              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491752 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.timeout                   = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491834 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.trust_id                  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.491916 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.user_domain_id            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492023 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.user_domain_name          = Default {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492100 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.user_id                   = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492193 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] nova.username                  = nova {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492303 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.auth_section         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492396 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.auth_type            = password {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492482 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.cafile               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492565 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.certfile             = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492651 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.collect_timing       = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492740 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.endpoint_type        = public {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492825 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.insecure             = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492907 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.keyfile              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.492991 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.region_name          = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493076 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.split_loggers        = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493158 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] placement.timeout              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493246 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.auth_section            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493347 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.auth_type               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493430 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.cafile                  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493513 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.certfile                = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493599 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.collect_timing          = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493681 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.connect_retries         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493765 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.connect_retry_delay     = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493850 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.enable_notifications    = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.493934 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.endpoint_override       = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494018 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.insecure                = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494103 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.interface               = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494187 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.keyfile                 = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494278 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.max_version             = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494374 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.min_version             = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494456 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.region_name             = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494540 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.retriable_status_codes  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494623 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.service_name            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494706 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.service_type            = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494789 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.split_loggers           = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494872 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.status_code_retries     = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.494954 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.status_code_retry_delay = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495037 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.timeout                 = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495120 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.valid_interfaces        = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495203 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ironic.version                 = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495307 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] cli_script.dry_run             = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495398 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495484 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495570 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495655 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495741 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495825 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495910 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.495997 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496119 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496210 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.hostname = np0000162743 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496312 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496404 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496491 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496579 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496667 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496756 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496841 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.496926 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497016 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497101 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497185 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497278 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497372 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497457 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497541 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497626 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497710 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497794 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497877 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.497961 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498045 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498134 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498221 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498322 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498411 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498499 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498583 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498673 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_notifications.driver = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498759 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_notifications.retry = -1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498851 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.498936 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_messaging_notifications.transport_url = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499024 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_reports.file_event_handler = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499111 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499194 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_reports.log_dir           = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499298 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499385 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.default_quota           = -1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499473 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499557 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_floatingip        = 50 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499642 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_network           = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499728 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_port              = 500 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499812 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_rbac_policy       = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499895 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_router            = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.499979 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_security_group    = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500078 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_security_group_rule = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500164 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.quota_subnet            = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500249 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] QUOTAS.track_quota_usage       = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500366 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500446 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.group                  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500530 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.helper_command         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500615 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.log_daemon_traceback   = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500706 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.logger_name            = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500791 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.thread_pool_size       = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500875 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep.user                   = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.500964 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501047 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.group     = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501128 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.helper_command = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501211 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501317 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501402 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501484 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_dhcp_release.user      = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501573 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501655 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.group        = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501736 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.helper_command = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501820 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501904 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.501987 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502068 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_ovs_vsctl.user         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502157 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.capabilities = [21] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502240 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.group        = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502339 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.helper_command = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502423 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.log_daemon_traceback = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502509 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502592 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.thread_pool_size = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502674 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_namespace.user         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502763 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.capabilities = [12] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502846 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.group        = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.502927 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.helper_command = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503010 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.log_daemon_traceback = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503097 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503180 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.thread_pool_size = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503262 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_conntrack.user         = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503368 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.capabilities      = [12, 21] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503451 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.group             = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503534 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.helper_command    = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503616 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.log_daemon_traceback = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503702 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503785 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.thread_pool_size  = 16 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503867 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] privsep_link.user              = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.503959 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504080 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504166 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] AGENT.use_helper_for_ns_read   = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504255 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] SECURITYGROUP.enable_ipset     = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504366 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] SECURITYGROUP.enable_security_group = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504450 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] SECURITYGROUP.firewall_driver  = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504536 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504625 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] experimental.ipv6_pd_enabled   = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504723 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504807 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.external_network_type      = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504898 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.mechanism_drivers          = ['ovn'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.504986 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.overlay_ip_version         = 4 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505072 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.path_mtu                   = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505159 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.physical_network_mtus      = {} {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505252 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.project_network_types      = ['geneve'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505359 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505452 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505546 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2_type_flat.flat_networks    = ['public'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505640 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2_type_geneve.max_header_size = 38 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505730 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505823 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505912 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_log.burst_limit        = 25 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.505996 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_log.local_output_log_base = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506081 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] network_log.rate_limit         = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506171 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.asyncio_connection    = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506254 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.asyncio_slave_connection = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506362 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.backend               = sqlalchemy {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506449 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.connection            = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506536 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.connection_debug      = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506624 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.connection_parameters =  {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506709 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.connection_recycle_time = 3600 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506795 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.connection_trace      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506878 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.db_inc_retry_interval = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.506962 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.db_max_retries        = 20 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507047 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.db_max_retry_interval = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507130 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.db_retry_interval     = 1 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507214 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.max_overflow          = 50 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507316 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.max_pool_size         = 5 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507398 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.max_retries           = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507484 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507568 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.mysql_wsrep_sync_wait = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507649 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.pool_timeout          = None {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507733 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.retry_interval        = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507816 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.slave_connection      = **** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507900 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.sqlite_synchronous    = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.507985 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.synchronous_reader    = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508083 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] database.use_db_reconnect      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508175 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.bfd_min_rx                 = 1000 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508262 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.bfd_min_tx                 = 100 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508368 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.bfd_mult                   = 3 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508451 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.broadcast_arps_to_all_routers = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508537 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.dhcp_default_lease_time    = 43200 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508622 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508707 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.dns_records_ovn_owned      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508838 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.dns_servers                = [] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508971 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.enable_distributed_floating_ip = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.508971 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.fdb_age_threshold          = 300 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509136 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ha_failover_strategy       = normal {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509136 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.live_migration_activation_strategy = rarp {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509209 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.localnet_learn_fdb         = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509298 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.mac_binding_age_threshold  = 300 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509391 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.neutron_sync_mode          = log {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509478 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_dhcp4_global_options   = {} {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509565 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_dhcp6_global_options   = {} {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509654 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_l3_scheduler           = leastloaded {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509741 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_metadata_enabled       = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509830 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.509964 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510005 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_nb_connection          = ['ssl:199.19.213.12:6641'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510086 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510171 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_router_indirect_snat   = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510258 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510362 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510455 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_sb_connection          = ['ssl:199.19.213.12:6642'] {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510541 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510626 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovs_create_tap             = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510713 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovsdb_connection_timeout   = 180 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510802 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovsdb_log_level            = INFO {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510886 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovsdb_probe_interval       = 60000 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.510971 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.ovsdb_retry_max_interval   = 180 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511057 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.stateless_nat_enabled      = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511145 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511236 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.bridge_mac_table_size      = 50000 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511337 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.igmp_flood                 = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511424 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.igmp_flood_reports         = True {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511508 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.igmp_flood_unregistered    = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511598 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.igmp_snooping_enable       = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511684 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] OVS.ovsdb_timeout              = 10 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511774 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511859 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn_nb_global.ignore_lsp_down  = False {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511947 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.511997 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG cotyledon.oslo_config_glue [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] ******************************************************************************** {{(pid=103588) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 02 05:50:20.512097 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG oslo_service.backend._threading.service [None req-6e4d68f7-79f1-4619-abe8-20a94ccc929a None None] Selected the multiprocessing context: <multiprocessing.context.ForkContext object at 0x77e0a68d0c50> and updated it in Cotyledon ServiceManager: <multiprocessing.context.ForkContext object at 0x77e0a68d0c50> {{(pid=103588) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:394}}
Apr 02 05:50:20.542757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=104358) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}}
Apr 02 05:50:20.543381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Apr 02 05:50:20.543381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Apr 02 05:50:20.543381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Apr 02 05:50:20.543381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Apr 02 05:50:20.543699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Apr 02 05:50:20.543800 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time                = 75 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.543933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover  = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.544115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk                     = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.544516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.544703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path            =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.544879 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config               = api-paste.ini {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] api_workers                    = 4 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545190 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy                  = keystone {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] backlog                        = 4096 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] bind_host                      = 0.0.0.0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] bind_port                      = 9696 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout          = 900 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] config_dir                     = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.545969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] config_source                  = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] control_exchange               = neutron {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546342 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] core_plugin                    = ml2 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546342 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] debug                          = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones     = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification        = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network        = 1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration            = 86400 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type                 = networks {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.546933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dns_domain                     = openstacklocal {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd       = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr                     = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents              = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default         = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp        = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] filter_validation              = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu             = 1430 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout      = 60 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.547901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] host                           = np0000162743 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp              = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] http_retries                   = 3 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] instance_format                = [instance: %(uuid)s]  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver                    = internal {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled                = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] l3_ha                          = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.548553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name    =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type             =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_color                      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_config_append              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_dir                        = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_file                       = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_options                    = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval            = 1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type       = days {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type              = none {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.549971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair       = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers            = 5 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_header_line                = 16384 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router       = 3 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count              = 30 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb            = 200 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_routes                     = 30 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes         = 20 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] my_ip                          = 199.19.213.12 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.550507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6                        = 2604:e100:1:0:f816:3eff:fe76:b894 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule          = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit           = -1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay           = 5 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval              = 40 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] publish_errors                 = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst               = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level        = CRITICAL {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval            = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] retry_until_window             = 30 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] router_distributed             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step  = 20 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout       = 600 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout           = 60 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.551870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers       = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers                    = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval           = 2 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] service_plugins                = ['ovn-router'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] setproctitle                   = on {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] shell_completion               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] state_path                     = /opt/stack/data/neutron {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility            = LOG_USER {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle                   = 600 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.552602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] transport_url                  = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] use_journal                    = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] use_json                       = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] use_ssl                        = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] use_stderr                     = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] use_syslog                     = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq                      = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size         = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive                = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug              = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string     = messaging:// {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled               = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type           = notification {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size        = 10000 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time        = 2m {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace    = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys             = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout        = 0.1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests        = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags   = {} {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.553983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope      = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout     = 60.0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554745 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type                 = password {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.554973 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url                  = https://199.19.213.12/identity {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile                    = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555058 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile                  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing            = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name       = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id                 = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555335 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type             = public {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure                  = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile                   = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.password                  = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name       = Default {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id                = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name              = service {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name               = RegionOne {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout                   = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.555957 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id                  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name          = Default {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id                   = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] nova.username                  = nova {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type            = password {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556358 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile             = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing       = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type        = public {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name          = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers        = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile                  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile                = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing          = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.556979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay     = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications    = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557102 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override       = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure                = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface               = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile                 = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version             = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557367 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version             = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name             = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type            = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers           = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries     = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout                 = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces        = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ironic.version                 = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557902 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.557999 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558157 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558351 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000162743 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558641 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558820 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.558993 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559319 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559433 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.559992 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir           = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota           = -1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560643 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip        = 50 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network           = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port              = 500 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router            = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560923 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group    = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.560997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet            = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage       = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561120 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.group                  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback   = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name            = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size       = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep.user                   = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group     = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user      = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group        = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.561932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group        = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group        = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user         = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities      = [12, 21] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562628 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group             = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command    = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562788 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size  = 16 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user              = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.562947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read   = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset     = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver  = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled   = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type      = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers          = ['ovn'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version         = 4 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563461 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu                   = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus      = {} {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types      = ['geneve'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks    = ['public'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit        = 25 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.563967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit         = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection    = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.backend               = sqlalchemy {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.connection            = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug      = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters =  {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564466 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries        = 20 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval     = 1 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow          = 50 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size         = 5 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries           = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout          = None {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval        = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection      = **** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.564973 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous    = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader    = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx                 = 1000 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx                 = 100 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult                   = 3 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time    = 43200 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers                = [] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold          = 300 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy       = normal {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb         = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold  = 300 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565764 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode          = log {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options   = {} {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options   = {} {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler           = leastloaded {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.565978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled       = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection          = ['ssl:199.19.213.12:6641'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat   = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566335 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection          = ['ssl:199.19.213.12:6642'] {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap             = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566563 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout   = 180 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level            = INFO {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval       = 60000 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval   = 180 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled      = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size      = 50000 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.566968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood                 = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567033 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports         = True {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered    = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable       = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout              = 10 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down  = False {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567366 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Apr 02 05:50:20.567404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=104358) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Apr 02 05:50:20.567557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [104358] {{(pid=104358) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}}
Apr 02 05:50:20.568668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-3968889', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-12414'] for process (None), after_init {{(pid=104358) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 02 05:50:20.570214 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
Apr 02 05:50:20.625376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 02 05:50:20.625582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 02 05:50:20.625582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 02 05:50:20.625716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.625716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.625826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.625826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.625937 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.625937 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.629487 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.12:6641: connecting...
Apr 02 05:50:20.635764 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.12:6641: connected
Apr 02 05:50:20.662997 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry
Apr 02 05:50:20.691281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 02 05:50:20.691377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Apr 02 05:50:20.691377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.691498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=104358) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 02 05:50:20.693292 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.12:6642: connecting...
Apr 02 05:50:20.698605 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.12:6642: connected
Apr 02 05:50:20.732336 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> floatingip precommit_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732466 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> floatingip precommit_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> floatingip before_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> floatingip before_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> port after_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x77e0a0b855b0>> port precommit_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.732953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-12964'] for port_forwarding_plugin (None), after_init {{(pid=104358) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 02 05:50:20.733021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> port_forwarding after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> router_interface after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> port_forwarding after_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> port_forwarding after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733280 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x77e0a0733b60>> router_interface after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733425 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 02 05:50:20.733477 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension
Apr 02 05:50:20.733869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x77e0a0b85550>> segment before_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.733933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x77e0a0b85550>> subnet precommit_delete_associations 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> segment_host_mapping after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_removal_from_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> segment_host_mapping after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> port after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> port after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> port after_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> segment after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734836 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> subnet after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> subnet after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.734947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x77e0a0732360>> subnet after_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.793389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77e0a0b9e210>> subnet after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.793533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77e0a0b9e210>> subnet after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.793533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77e0a0b9e210>> subnet before_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.793630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x77e0a0b9e210>> subnet before_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.795701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_resource_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x77e0a19f3e00>> security_group after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.795780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_target_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x77e0a19f3e00>> port after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.795901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-1388707'] for logging-plugin (None), after_init {{(pid=104358) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 02 05:50:20.796233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77e0a0b82a80>> security_group_rule after_create 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.796325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77e0a0b82a80>> security_group_rule after_update 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:20.796389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x77e0a0b82a80>> security_group_rule after_delete 55550000, False {{(pid=104358) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Apr 02 05:50:30.278395 np0000162743 neutron-ovn-maintenance-worker[103588]: DEBUG dbcounter [-] [103588] Writing DB stats neutron:SELECT=4 {{(pid=103588) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:50:30.797484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-04-02 05:50:30.797064 {{(pid=104358) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:99}}
Apr 02 05:50:30.800150 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync port groups started @ 2026-04-02 05:50:30.799644 {{(pid=104358) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:132}}
Apr 02 05:50:30.817805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writer thread running {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Apr 02 05:50:30.830141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync port groups completed @ 2026-04-02 05:50:30.829874 {{(pid=104358) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:196}}
Apr 02 05:50:30.830345 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-04-02 05:50:30.830129 {{(pid=104358) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1125}}
Apr 02 05:50:30.960529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.services.segments.db [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x77e0a0a9ca40>,) {'filters': {'network_id': ['0552b30f-5ca8-46d7-8291-6694737449be'], 'is_dynamic': False}} {{(pid=104358) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Apr 02 05:50:30.966155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync metadata ports started {{(pid=104358) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1070}}
Apr 02 05:50:31.044968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync metadata ports completed {{(pid=104358) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1122}}
Apr 02 05:50:31.044968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=104358) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:922}}
Apr 02 05:50:31.282401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-04-02 05:50:31.282160 {{(pid=104358) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:995}}
Apr 02 05:50:31.283122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 02 05:50:31.283405 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=104358) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1000}}
Apr 02 05:50:31.283611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=104358) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1059}}
Apr 02 05:50:31.283611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-04-02 05:50:31.283468 {{(pid=104358) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1294}}
Apr 02 05:50:31.283789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync ACLs started @ 2026-04-02 05:50:31.283578 {{(pid=104358) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:239}}
Apr 02 05:50:31.319416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync ACLs completed @ 2026-04-02 05:50:31.319093 {{(pid=104358) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:429}}
Apr 02 05:50:31.319644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync routers and router ports started @ 2026-04-02 05:50:31.319346 {{(pid=104358) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:596}}
Apr 02 05:50:31.365594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 02 05:50:31.365906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync routers and router ports completed @ 2026-04-02 05:50:31.365657 {{(pid=104358) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:917}}
Apr 02 05:50:31.366009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync port QoS policies started @ 2026-04-02 05:50:31.365888 {{(pid=104358) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1342}}
Apr 02 05:50:31.366081 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] Starting OVNClientQosExtension
Apr 02 05:50:31.380850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync port QoS policies completed @ 2026-04-02 05:50:31.380209 {{(pid=104358) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1365}}
Apr 02 05:50:31.380850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync Floating IP QoS policies started @ 2026-04-02 05:50:31.380366 {{(pid=104358) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1370}}
Apr 02 05:50:31.380850 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] Starting OVNClientQosExtension
Apr 02 05:50:31.400868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-04-02 05:50:31.400663 {{(pid=104358) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1393}}
Apr 02 05:50:31.401175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync Floating IP NAT rules started @ 2026-04-02 05:50:31.400839 {{(pid=104358) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1398}}
Apr 02 05:50:31.401175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-04-02 05:50:31.401042 {{(pid=104358) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1421}}
Apr 02 05:50:31.401388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-2cfd2b1e-c95c-45c5-bd38-f0ae932cc134 None None] OVN-Northbound DB sync process completed @ 2026-04-02 05:50:31.401131 {{(pid=104358) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:112}}
Apr 02 05:50:40.799598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-04-02 05:50:40.799141 {{(pid=104358) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1449}}
Apr 02 05:50:40.800498 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 02 05:50:40.802583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] OVN-SB Sync hostname and physical networks started @ 2026-04-02 05:50:40.802007 {{(pid=104358) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1476}}
Apr 02 05:50:40.805339 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.806797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.806997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807297 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.807941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808190 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.808936 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809058 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.809686 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=104358) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:96}}
Apr 02 05:50:40.811576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.812707 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started
Apr 02 05:50:40.812805 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization
Apr 02 05:50:40.814912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.817230 np0000162743 neutron-ovn-maintenance-worker[104358]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] New host np0000162743 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron
Apr 02 05:50:40.818291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.825756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.829590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:40.830078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.832063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.835288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:40.836861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.839781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:40.841533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:40.848654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.858075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.859561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 02 05:50:40.875711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:40.876805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.881433 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.882698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG oslo_concurrency.lockutils [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=104358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 05:50:40.884846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG oslo_concurrency.lockutils [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.002s {{(pid=104358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 05:50:40.887470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.899919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.910461 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.919021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:40.919299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:40.921133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.923010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:40.936086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:50:40.946621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:40.946621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:40.959022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:41.026109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.027300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:41.029305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.072087 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.096088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 916, in configure_nb_global
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:50:41.128303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.128937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.129544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.129544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.130813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.140428 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron_lib.callbacks.manager [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-1175542', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-2427442'] for segment_host_mapping (None), after_create {{(pid=104358) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Apr 02 05:50:41.145876 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.db.ovn_hash_ring_db [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Cleaned up Hash Ring nodes older than 5 days
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.164038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.164643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.165177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.181731 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Maintenance task: No inconsistencies found. Skipping {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:383}}
Apr 02 05:50:41.186001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.186126 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.197778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.199711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=bdb7d894-e820-4e09-b8d9-6ae00d92d822, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-0552b30f-5ca8-46d7-8291-6694737449be', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96', 'neutron:subnet_ids': '0b95871b-d043-4e3f-83e1-eeb5f42fa684'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'slaac', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:f0:0c:9f', name='lrp-80db5d56-67be-4e71-82eb-8e41db2381f9', networks=['fd83:6b99:4edb::1/64'], options={}, peer=[], status={}) old= {{(pid=104358) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 02 05:50:41.203489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.211243 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:41.224204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.224710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:50:41.225765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.226215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.226722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.226722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.226722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.229545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.235903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in external_ids of LRPs. {{(pid=104358) update_lrouter_ports_ext_ids_name_prefix /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:500}}
Apr 02 05:50:41.237730 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Apr 02 05:50:41.251427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.251960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.254863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.258483 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:41.259500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.260013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:41.265126 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in LRPs (took 0.02 seconds)
Apr 02 05:50:41.273105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:50:41.280948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.281590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.282565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.282565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.284092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.284641 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.285377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.services.segments.db [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] Segments {'709ccde1-cd6a-48f6-9f17-ee75c4c1e73b'} mapped to the host np0000162743 {{(pid=104358) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}}
Apr 02 05:50:41.288978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.295808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.295979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.307063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Traceback (most recent call last):
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.311491 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.317922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.318908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.319750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG oslo_concurrency.lockutils [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.429s {{(pid=104358) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 05:50:41.319750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] OVN-SB Sync hostname and physical networks completed @ 2026-04-02 05:50:41.318147 {{(pid=104358) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1503}}
Apr 02 05:50:41.319750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.325049 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=104358) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Apr 02 05:50:41.331748 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.401680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.443147 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.446048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Traceback (most recent call last):
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.447189 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:41.507725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.508395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.570067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.631019 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-0552b30f-5ca8-46d7-8291-6694737449be synchronized; highest priority chassis 06dda8f5-c11d-4346-a529-a34c0fcd4ade
Apr 02 05:50:41.633588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '0552b30f-5ca8-46d7-8291-6694737449be', 'neutron:router_id': '9138e1c1-ce66-478a-856d-dca0afa5ba96'}),), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.634184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-0552b30f-5ca8-46d7-8291-6694737449be, chassis=06dda8f5-c11d-4346-a529-a34c0fcd4ade, priority=1, columns={}) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:41.642304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.643213 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 02 05:50:41.655091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise result.ex
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:41.655812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event 
Apr 02 05:50:41.656634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=104358) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Apr 02 05:50:41.973835 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Apr 02 05:50:41.974552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-0212b5f7-91c8-4ea2-8d1e-1ad47189d26c None None] OVN-Southbound DB sync process completed @ 2026-04-02 05:50:41.973913 {{(pid=104358) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1457}}
Apr 02 05:50:42.789005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=536f83a0-b638-4756-8108-28b408b098d7, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:revision_number': '8', 'neutron:router_name': 'neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85'}, gateway_chassis=[ca9d5fa8-332a-4323-8b51-0f776d885d5b], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d0:08:50', name='lrp-0b539c16-0f8c-4ee9-838a-f793194f9667', networks=['172.24.5.129/24', '2001:db8::be/64'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104358) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 02 05:50:42.790515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=e3267dfc-82ee-4fe0-86fe-e0dbb550f026, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca'}, gateway_chassis=[ca9d5fa8-332a-4323-8b51-0f776d885d5b], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:d0:08:50', name='lrp-0b539c16-0f8c-4ee9-838a-f793194f9667', networks=['172.24.5.129/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={'hosting-chassis': '06dda8f5-c11d-4346-a529-a34c0fcd4ade'}) old= {{(pid=104358) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 02 05:50:42.828562 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-0552b30f-5ca8-46d7-8291-6694737449be synchronized; highest priority chassis 06dda8f5-c11d-4346-a529-a34c0fcd4ade
Apr 02 05:50:42.828915 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '0552b30f-5ca8-46d7-8291-6694737449be', 'neutron:router_id': '9138e1c1-ce66-478a-856d-dca0afa5ba96'}),), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:42.829079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-0552b30f-5ca8-46d7-8291-6694737449be, chassis=06dda8f5-c11d-4346-a529-a34c0fcd4ade, priority=1, columns={}) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:42.829201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.829606 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 89, in run
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:42.830388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise result.ex
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.831334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event 
Apr 02 05:50:42.857506 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-0552b30f-5ca8-46d7-8291-6694737449be synchronized; highest priority chassis 06dda8f5-c11d-4346-a529-a34c0fcd4ade
Apr 02 05:50:42.857862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '0552b30f-5ca8-46d7-8291-6694737449be', 'neutron:router_id': '9138e1c1-ce66-478a-856d-dca0afa5ba96'}),), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:42.858007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-0552b30f-5ca8-46d7-8291-6694737449be, chassis=06dda8f5-c11d-4346-a529-a34c0fcd4ade, priority=1, columns={}) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:42.858128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.858518 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 81, in run
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:42.859293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise result.ex
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:42.860131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event 
Apr 02 05:50:45.831750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:45.834022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:45.865137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:45.865137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.865424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.866484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.868217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:45.901441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:45.903177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:45.903447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.904173 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.906052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.906781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:45.926887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:45.928725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:50:45.929083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:45.929245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.929726 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:45.930863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.931343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:50:45.932105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:45.932577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:45.933070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:45.933070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:45.933070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:46.185842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:46.187524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:46.187857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:46.188242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.189106 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:46.190551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.191316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:50:46.192369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:46.193309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:46.194314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.194314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:46.233362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:46.236184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:46.236685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:46.237015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:46.237151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.237873 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.239192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:46.240090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:50.833408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:50.835533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:50.860700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:50.860866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.861331 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.862118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.863027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:50.902595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:50.904076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:50.904449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.905121 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.906138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.906849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:50.928818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:50.929962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:50:50.930496 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:50.930824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.931739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:50.932613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.933389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:50:50.933803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:50.934560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:50.935469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:50.935469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:50.935469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:51.187241 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:51.188312 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:51.188888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:51.189333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:51.192036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.192676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:51.193181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.193954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:51.235314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:51.236864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:51.237224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:51.237479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.238241 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.240041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:51.240917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:55.835239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:55.836999 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:55.870131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:55.870690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.871682 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.872973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.873835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:55.903741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:55.905904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:55.906328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.909295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:55.910195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.911223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.911223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:55.911223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.911223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:55.931287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:55.931287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:50:55.931287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:55.931287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.931756 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:55.932690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.933156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:50:55.936281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:55.936634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:55.937080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:55.937080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:55.937080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:56.188451 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:56.189498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:56.190259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:56.190716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.191576 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:50:56.192979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.193761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:50:56.194861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:56.195902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:56.196784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.196784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:50:56.236379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:50:56.237436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:50:56.238163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:56.238163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:50:56.238421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.238903 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.240570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:50:56.241522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:00.835989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:00.837518 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:00.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:00.862917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.863043 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.863982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.865307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:00.904831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:00.906302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:00.906515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.907235 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.909497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.910358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:00.931027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:00.932012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:00.932477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:00.932697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.933281 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:00.934713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.935508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:00.936260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:00.937051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:00.937940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:00.937940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:00.937940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:01.189889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:01.190794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:01.191590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:01.192011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.192831 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:01.194398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.195206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:01.196118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:01.196929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:01.198440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.198440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:01.237456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:01.238521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:01.238961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:01.239508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:01.239731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.240411 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.242563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:01.243744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:05.893546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:05.894963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:05.905790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:05.912840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:05.914906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.917682 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.920041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.920762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Traceback (most recent call last):
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.933300 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.933870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.938521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:05.939089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:05.939422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:05.939757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:05.940089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:05.942985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:06.191353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:06.192153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:06.193008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:06.193488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.194373 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:06.195365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.196383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:06.196925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.197556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:06.238561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:06.239600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:06.240609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:06.241073 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:06.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.242239 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.244106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:06.244946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:10.894599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:10.964079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:10.965490 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:10.966014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:10.967479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:10.970988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:10.973996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.976967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.979443 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:10.980644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.983868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:10.984868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.985758 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:10.987247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:10.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:10.989412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:10.989897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:10.989897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:10.989897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:11.006408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:11.006730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Traceback (most recent call last):
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.007368 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.008766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.009753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:11.192576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:11.194291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:11.195125 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:11.195491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.196144 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:11.197504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.198192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:11.199109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.199842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:11.200681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.200681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:11.239697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:11.241915 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:11.242413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:11.242784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:11.242998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.243750 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.245638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:11.246514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:15.896074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:15.898564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:15.933020 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:15.933481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.934342 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.935299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.936112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:15.966740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:15.967954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:15.969719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:15.970001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.970673 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:15.971321 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:15.971522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.973102 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.974773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.975348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.976382 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:15.977337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.978202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:15.978645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:15.979623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:15.980757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:15.980757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:15.980757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:16.194817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:16.196554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:16.197184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:16.197637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.199042 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:16.199901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.200687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:16.202043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:16.202984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:16.204019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.204019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:16.241958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:16.243072 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:16.243661 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:16.244059 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:16.244235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.244970 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.246687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:16.247497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:20.898114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:20.900240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:20.933867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:20.934665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.935685 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.936637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.937394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:20.968595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:20.970116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:20.970600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:20.970837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.971891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.972295 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:20.973662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.975258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.975849 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:20.976563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.977696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:20.978201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:20.978798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:20.979147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:20.979147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:20.979147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:21.196591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:21.197566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:21.199405 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:21.199405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.199531 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:21.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.201963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:21.203366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.204080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:21.243027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:21.244520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:21.245978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:21.245978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:21.245978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.246410 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.247307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:21.248097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:25.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:25.901980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:25.935444 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:25.935695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.936440 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.938049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.938538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:25.970011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:25.971208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:25.971470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.971934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.972206 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.973651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.974353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:25.975026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:25.975079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:25.975462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.976217 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:25.977596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.978053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:25.979256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:25.979707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:25.980178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:25.980178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:25.980178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:26.197982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:26.198763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:26.199571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:26.200010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.200801 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:26.201916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:26.203368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:26.204690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:26.205911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.205911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:26.244739 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:26.245819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:26.246474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:26.246733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:26.246812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.247748 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.249582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:26.250560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:30.900952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:30.902918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:30.906399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=577,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:51:30.938878 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:30.938878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.939409 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.940727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.941213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:30.971740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:30.973737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:30.973737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.974404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.975557 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.977884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.978506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:30.979039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:30.979213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:30.979597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.980724 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:30.982183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.982613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:30.984574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:30.985199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:30.985886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:30.985886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:30.985886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:31.199719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:31.200756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:31.201204 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:31.201711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.202456 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:31.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.204435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:31.204864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:31.205630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:31.206478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.206478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:31.245920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:31.246949 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:31.247454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:31.247812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:31.247989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.248790 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.250717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:31.251603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:35.904153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:35.906585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:35.937182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:35.937562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.938479 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.940021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.940832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:35.973626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:35.975495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:35.975860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.976883 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:35.977478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.979409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.980210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.981783 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:35.982673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.983421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:35.984118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:35.985410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:35.986664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:35.986664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:35.986664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:36.200958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:36.202181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:36.202779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:36.203166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.204073 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:36.205792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.206221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:36.207771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:36.208227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:36.208786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.208786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:36.246851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:36.247714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:36.248302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:36.248746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:36.248933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.249960 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.251130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:36.251966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:40.905603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:40.908558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:40.953391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:40.954164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.955053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:40.975062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:40.976593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:40.976902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.977694 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.978919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.979701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:40.980528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:40.980528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:40.980528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:40.980528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.981207 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:40.982544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.983447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:40.984055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:40.984961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:40.985859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:40.985859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:40.985859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:41.202212 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:41.202735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:41.203944 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:41.204372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.205261 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:41.206623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.207570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:41.208202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:41.208945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:41.209804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.209804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:41.247721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:41.248149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:41.248874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:41.249282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:41.249513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.251134 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.253287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:41.254152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:45.907755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:45.910258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:45.947028 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:45.947346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Traceback (most recent call last):
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.948043 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.949908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.950642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:45.976255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:45.977209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:45.977551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.978231 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.979121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.979835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:45.980340 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:45.980340 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:45.980871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:45.981139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.981905 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:45.983442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.983944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:45.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:45.985725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:45.986227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:45.986227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:45.986227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:46.202967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:46.203436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:46.204199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:46.204728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.205494 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:46.207103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.208160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:46.208864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:46.209530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:46.210451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.210451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:46.248240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:46.249046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:46.249503 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:46.249833 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:46.250478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.250905 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.253545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:46.254744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:50.909251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:50.911076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:50.958656 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:50.959050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.960204 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.961429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.962335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:50.976982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:50.978318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:50.979022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.980259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.980695 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:50.981158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.983491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.984378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.985301 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:50.986182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.987198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:50.988141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:50.989051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:50.989630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:50.989630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:50.989630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:51.203821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:51.204443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:51.205078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:51.205608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.206517 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:51.208009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.208900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:51.244741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:51.245155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:51.246055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.246055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:51.248701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:51.249086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:51.249459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:51.249740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:51.249878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.250421 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.251165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:51.251558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:55.909935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:55.912359 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:55.946314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:55.946748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.947597 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.948587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.949492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:55.977736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:55.978711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:55.979094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.979838 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.981612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.982347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:55.983087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:55.983087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:51:55.983087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:55.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.983923 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:55.985288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.986095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:51:55.986798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:55.987301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:55.987796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:55.987796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:55.987796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:56.204432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:56.204957 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:56.205579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:56.205943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.206703 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:51:56.207977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.208431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:51:56.209676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:56.210118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:56.210670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.210670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:51:56.249313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:51:56.249978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:51:56.250538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:51:56.301674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:51:56.302695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:51:56.304127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:00.911838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:00.914422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:00.946073 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:00.946443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.947223 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.948430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.949349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:00.978423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:00.979296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:00.979645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.980380 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.981966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.983323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:00.984129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:00.984129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:00.984129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:00.984129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.984474 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:00.985926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.986392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:00.987466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:00.987987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:00.988599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:00.988599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:00.988599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:01.205079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:01.205664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:01.206920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:01.206920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.207614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:01.209410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.210068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:01.211552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:01.212259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:01.213049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.213049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:01.249960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:01.250568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:01.251384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:01.251801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:01.251986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.252846 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.254756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:01.255678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:05.913634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:05.915670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:05.951063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:05.951451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.952166 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.953006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.953902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:05.978906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:05.980698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:05.980985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.981876 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.984673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.985424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:05.986104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:05.986104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:05.986104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:05.986272 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.986914 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:05.988063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.988842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:05.989661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:05.990410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:05.991230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:05.991230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:05.991230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:06.205863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:06.206430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:06.207101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:06.207538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.208411 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:06.210059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.211062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:06.212020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:06.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:06.214010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.214010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:06.250636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:06.251222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:06.251802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:06.252170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:06.252405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.253206 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.255297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:06.256142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:10.914452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:10.916373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:10.951234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:10.951716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.952625 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.953801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.955076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:10.979423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:10.980514 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:10.980843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.981875 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.983385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.984139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:10.985450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:10.986292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:10.986913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:10.987203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.988153 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:10.989616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.990042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:10.991459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:10.991876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:10.992380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:10.992380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:10.992380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:11.206913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:11.207693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:11.208474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:11.208905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.209784 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:11.211130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.211988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:11.213065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:11.213778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:11.214632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.214632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:11.251158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:11.251509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:11.252279 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:11.252781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:11.253026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.254029 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.255648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:11.256446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:15.915622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:15.917958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:15.953938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:15.954421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.955480 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.957012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.957873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:15.979959 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:15.981006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:15.981309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.982152 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.982972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.983833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:15.985885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:15.986076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:15.986500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:15.986766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.987317 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:15.987864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.988660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:15.989436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:15.990297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:16.207830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:16.208438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:16.209245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:16.209702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.210523 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:16.211449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.211947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:16.212486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:16.212997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:16.213541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.213541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:16.251819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:16.252395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:16.253086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:16.253562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:16.253774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.254617 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.255844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:16.256339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:20.917174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:20.919232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:20.944878 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:20.945215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.946077 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.947147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.947972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:20.980669 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:20.981930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:20.982239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.982946 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.984204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.985071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:20.986136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:20.986551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:20.987044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:20.987376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.987961 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:20.988862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.989414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:20.989923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:20.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:20.990886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:20.990886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:20.990886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:21.208626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:21.209046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:21.210058 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:21.210817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.212009 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:21.213525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.214329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:21.215803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:21.216664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:21.217555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.217555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:21.252583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:21.253195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:21.253818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:21.254404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:21.254634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.256644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:21.257124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:21.257612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:21.257612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:21.257612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:21.257612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:25.918455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:25.920219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:25.956990 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:25.957704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.958734 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.959797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.960635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:25.981376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:25.985971 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:25.985971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.986896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.987160 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.988801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.989250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:25.989859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:25.989859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:25.989859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.990396 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:25.991404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.991825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:25.992526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:25.993046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:25.993604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:25.993604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:25.993604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:26.209679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:26.211031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:26.211934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:26.212461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.213348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:26.214833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.215575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:26.216445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:26.217175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:26.218312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.218312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:26.253105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:26.253604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:26.253925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:26.254191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:26.254329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.254904 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.257027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:26.257923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:30.919336 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:30.921145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:30.941301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=247 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:52:30.965934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:30.966260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.967145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.969660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.970609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:30.981965 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:30.983803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:30.984227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.985255 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.987298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.988091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:30.988962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:30.988962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:30.988962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:30.989213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.989963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:30.991290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.992095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:30.993062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:30.993545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:30.994046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:30.994046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:30.994046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:31.211256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:31.211726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:31.212625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:31.213105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.213841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:31.215294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.215844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:31.217309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:31.217884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:31.218789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.218789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:31.253591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:31.254071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:31.254877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:31.255671 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:31.255671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.256478 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.258229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:31.260337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:40.882127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.883847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:40.884357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.887100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.887619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.890178 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:40.890578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:40.895016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.895377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:40.896648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:40.899386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.899989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.900601 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:40.901655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:40.905133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:40.905703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:40.907848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.908328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:40.908906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.908906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:40.908970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.910045 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.913545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.914084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:40.928492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:40.928492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:40.929888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:40.930937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:40.932181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:45.932841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:45.933617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:45.933769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:45.933769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:45.934041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:45.935225 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.942781 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:45.943231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.943918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:45.945033 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.945033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.945033 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.945033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.945468 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:45.947737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.948203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.951283 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:45.951627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:45.955579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.956801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:45.958918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:45.960913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:45.962126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.962932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:45.963839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.963839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:45.963839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.964404 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.966365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.966694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:45.981961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:45.982404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.983101 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.983912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:45.984714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:50.963299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:50.965428 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:50.965505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:50.965583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:50.965649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:50.966562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:50.967990 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:50.968606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:50.968825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:50.969422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:50.969572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.970066 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.971666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.972218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:50.972740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:50.972740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.977845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:50.984922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:50.985987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:50.988443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.989306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.990306 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:50.991856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:50.992615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:50.996352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.997224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:50.998380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.998380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:50.998380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:50.998380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:50.998711 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:51.001979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.002509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:51.019716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:51.020054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.020949 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:51.022043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:51.023109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:55.966421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:55.967735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:55.967929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:55.968106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:55.970719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:52:55.971788 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:52:55.972587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:55.973852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:55.974300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:55.974646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:52:55.975714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Traceback (most recent call last):
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.976526 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:55.977394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:55.979167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.979602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:55.980032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.981402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:55.981717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.982920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.988235 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:55.989956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.990880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:55.996012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:55.996806 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:52:56.002383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.003228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:56.004147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.004147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:56.004147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:52:56.006155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.007024 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:52:56.008477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.009216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.010073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:56.010073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.010073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.010891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.011385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:52:56.026987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:52:56.027401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.028107 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.028943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:52:56.029702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:01.024557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:01.025021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:01.025021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:01.025094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:01.025336 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:01.026220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:01.027442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:01.027832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:01.027939 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.028278 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:01.028847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.029958 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:01.030361 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.032045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.032592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:01.033097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.035328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.035551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.035848 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:01.036971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.037684 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:01.038406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.039077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.039910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:01.039910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.039910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:01.039910 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:01.040370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.040967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:01.041413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:01.047290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.048057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.048907 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.050501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.051234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:01.071075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:01.071521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.072256 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.073083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:01.073746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:06.025935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:06.026880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:06.026880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:06.026880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:06.027696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:06.028867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:06.030371 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:06.031623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:06.031847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:06.032740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.033139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.034216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.034876 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:06.035293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.036915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.037567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.038330 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.040014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.041085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:06.041785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.041785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.041785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.041785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.042041 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.042461 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:06.044198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.044779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:06.045658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.046053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:06.046956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.047418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:06.048129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.048129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:06.048741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.049241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.049763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:06.049763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.049763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:06.134956 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:06.135352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.136255 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.137421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:06.137865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:11.027096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:11.027716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:11.029136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:11.029478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:11.030133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:11.030775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:11.031574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:11.031917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:11.033321 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.033867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:11.034129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.034829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.035051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.035691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:11.037296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.037955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.039005 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:11.042701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.043539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.044406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:11.044406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.044406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:11.044406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:11.045430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.046246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:11.048090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.048706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.048963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.049093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.053383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.053892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.054384 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:11.056628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.057138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:11.060890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.061584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:11.062090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.062090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:11.080557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:11.080769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.081434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.082604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:11.083454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:16.027856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:16.028698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:16.030196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:16.031540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:16.032439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:16.032927 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.034318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:16.034759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:16.035085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.040325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:16.040605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:16.040795 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.041327 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:16.041835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:16.048716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:16.049735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:16.050883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:16.052849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:16.054000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:16.056241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.057783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.058893 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:16.059455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:16.062014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.062962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:16.063603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:16.066359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.067085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:16.067769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.067769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:16.068035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.069826 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.072651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.073299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:16.083909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:16.084185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.084995 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.086095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:16.087165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:21.028913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:21.029718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:21.031497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.032379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.033347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:21.033552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:21.034101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:21.034820 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.035121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.036014 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.038017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.038507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.038999 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:21.039683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:21.040112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:21.042751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.043188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:21.043468 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:21.044209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:21.046919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.047780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.048625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:21.048625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.048625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:21.048625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.048625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.049311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.052034 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:21.052570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.052570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:21.057236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.057800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.059130 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:21.060638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.061169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.061685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.062209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:21.062794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.062794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:21.081155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:21.081754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.082568 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.083528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:21.084057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:26.029908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:26.030875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:26.032285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.032765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.033708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:26.035554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:26.036350 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.037899 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:26.039471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.040348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:26.041644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.042501 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:26.043051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.043618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:26.044625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.044993 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:26.046037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:26.047227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.048029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:26.053111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:26.057728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.058668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.059878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:26.059878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.059878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:26.059878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.061504 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:26.063228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:26.064740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:26.067709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.068154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:26.068666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.068666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:26.068666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.068666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.068924 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.071902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.072677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:26.087617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:26.087948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.088854 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.090100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:26.090873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:31.030902 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:31.031872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:31.033383 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:31.034965 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.035367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.036545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=213 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:53:31.039097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.039696 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:31.044800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.046444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:31.047787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:31.047787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:31.047787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:31.048098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:31.048774 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:31.051665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.052044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.054439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.054716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.054905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.055676 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.058009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.058860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.060172 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:31.061483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:31.064289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.065139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:31.065722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:31.069717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.070536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.071452 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:31.074027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.075000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:31.078976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.079492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:31.079979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.079979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:31.089839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:31.090291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.091234 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.092398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:31.093158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:36.031875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:36.033794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:36.034976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:36.037152 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.038104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.043487 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:36.045531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.046192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:36.046921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:36.047647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:36.048256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.048545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.049145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:36.052662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.053520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:36.054142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.055336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:36.056222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:36.057829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:36.058834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.059190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.061465 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:36.063650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.064180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:36.064848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.065472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:36.066149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.066149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:36.066149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.066149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.066149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.067516 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.068904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.069626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:36.090413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:36.090791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.091540 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.092420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:36.093841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:41.032674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:41.034742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:41.037985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:41.043495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.043824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.044836 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:41.048969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.050653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:41.051807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:41.051807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:41.051807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.051807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.052974 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:41.054241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.054759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:41.056134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.056603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.057197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:41.057197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.057197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:41.057885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:41.058152 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:41.058812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:41.059573 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:41.059991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.060223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.060808 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:41.064187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.064622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:41.065796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:41.069212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.069729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:41.070398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.070398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:41.070398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.070398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.071732 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.076319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:41.089550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:41.089855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.090704 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.091750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:41.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:46.033306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:46.035329 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:46.038570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:46.043841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.049581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.051724 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.054251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.055166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:46.056458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:46.056531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:46.059183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.059505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.061455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:46.061697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:46.062363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:46.064113 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.064503 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:46.065560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:46.067419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.067893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:46.070714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:46.073565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.074467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.075296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:46.075296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.075296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:46.075296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.076225 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:46.077460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:46.080051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.080623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:46.081242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:46.083161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.083665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:46.084198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.084198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.084625 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.087072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.087599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:46.097098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:46.097474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Traceback (most recent call last):
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.098204 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.099527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:46.100415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:51.034107 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:51.035623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:51.042119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:51.048084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.048543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.051586 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.055220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.056083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:51.057382 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:51.058041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:51.058521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.058715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.060400 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:51.061898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.062677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:51.064988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.065433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.065934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:51.065934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.065934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:51.066728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:51.066866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:51.067284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:51.068734 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:51.071142 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.071578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.073591 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:51.075898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.076651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:51.077054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:51.080723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.081616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.082815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.086364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.087308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:51.091020 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:51.091428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.092572 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.094174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:51.094660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:56.034732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:56.036652 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:56.047150 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:56.049708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.050056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.053259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:56.056321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.057176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:56.059681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:56.061188 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:53:56.061907 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.064454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.066541 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:56.070069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.070590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:53:56.072782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.073258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.073808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:56.073808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.073808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:56.073808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:56.073808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:53:56.074532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:56.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:53:56.078647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.079894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.081011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.082211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.082432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.083259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.086078 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.087922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.088686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:53:56.090926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.091635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:53:56.093627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.094127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:56.094731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.094731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:53:56.095742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:53:56.096089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Traceback (most recent call last):
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.096868 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.097992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:53:56.098550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:01.035403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:01.037160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:01.050852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:01.050852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.051202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.053206 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.061695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.062382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:01.064757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:01.065493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:01.067420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.067728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.068954 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:01.072965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.073429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:01.076787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.077614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:01.078558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:01.079910 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.080261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.082156 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:01.083603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.084018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:01.084802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:01.086473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.086937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:01.087456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.087456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:01.087456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.087456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.088697 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.090092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.090590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:01.100821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:01.101213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Traceback (most recent call last):
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.102100 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-3b4c834e-fb65-4e0e-bc0b-a90af2d76454 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.103214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:01.104137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:06.036161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:06.038431 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:06.050788 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:06.052184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.052694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.056015 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:06.063859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.064600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:06.065470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:06.066671 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:06.068373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.069995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.071887 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:06.075044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.075591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:06.076765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.077380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.077927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:06.077927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.077927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:06.079691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:06.079962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:06.080446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:06.081064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:06.081882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.083483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.084567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.086119 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:06.086374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:06.088467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.088954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:06.089527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:06.092001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.092507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.093028 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.093768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.094215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.094676 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.095637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:06.096143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:11.036843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:11.038613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:11.051422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:11.055883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.055883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.056424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.060130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.060736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:11.067428 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:11.068844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:11.069472 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.071103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.071882 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:11.072540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.073066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:11.073423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.074214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.074752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:11.074752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.074752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:11.080565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:11.080974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:11.081505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:11.083246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.084699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:11.084973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.086644 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:11.088637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.089500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:11.090302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.091038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:11.091534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.091534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:11.092887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.092887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.092887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.093134 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.095280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.095759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:11.096870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:11.096870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Traceback (most recent call last):
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.097237 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.099686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:11.100593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:16.037537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:16.039427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:16.052246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:16.054442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.054984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.057079 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.060411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.061223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:16.069604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:16.070976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:16.073217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.074085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.076741 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:16.079349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.080386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:16.081659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.082514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.083183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:16.083183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.083183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:16.083183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:16.083183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:16.083683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:16.084360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.085576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:16.085821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.087013 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:16.088856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:16.089511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:16.091153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.091705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:16.092195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.092195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:16.092195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.092195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.092505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:16.092827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.093307 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.094987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:16.095740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.096264 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.096564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:16.097210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:21.038324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:21.039901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:21.053660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:21.056683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.058706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.060294 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.067888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.068461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:21.071727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:21.072103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:21.073558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.075118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.078113 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:21.080613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.081090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:21.084355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.085123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:21.085979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:21.086330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:21.087370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.087651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.088249 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.088515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.089170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.089719 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.091481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.092365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:21.092882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:21.093356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:21.095117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.095597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:21.096091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.096091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:21.096091 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:21.096091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.096630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.097703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:21.098189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:26.038850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:26.040415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3d99979a-5b73-4b7d-84b4-2bf975775ab3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:26.054872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:26.055916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.056102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.056732 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.059785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.060254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:26.072765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:26.075115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:26.078018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.078341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.079083 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:26.080633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.081683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:26.083717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.084370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.085156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:26.085156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.085156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:26.086147 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:26.086400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:26.086818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:26.087405 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:26.088072 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.088818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.089924 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:26.090955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:26.091377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:26.092483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.092903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:26.093393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.093393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:26.093393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.093393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.093738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:26.094072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.095006 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.096047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.096528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3d99979a-5b73-4b7d-84b4-2bf975775ab3 None None] Traceback (most recent call last):
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-3d99979a-5b73-4b7d-84b4-2bf975775ab3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.098456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:26.098923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:31.039331 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:31.041686 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:31.046162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:54:31.055804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:31.057401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.058072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.061132 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.063756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.064753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:31.074976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:31.075455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:31.079630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.080381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Traceback (most recent call last):
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.083888 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:31.085670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.086536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:31.088233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.089296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.090452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:31.090452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.090452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:31.090452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:31.090452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:31.092187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:31.092970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:31.093281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.093518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.095002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.095584 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:31.096333 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:31.097331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:31.097733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:31.101733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.102685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:31.103527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.103527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Traceback (most recent call last):
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.104521 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.107874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.108834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:31.112620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:31.112852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.113366 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.114460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:31.115007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:36.040054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:36.041887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:36.056450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:36.059611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.060293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.062463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.065340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.066111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:36.076743 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:36.077905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:36.078504 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.078838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.080639 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:36.081744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.082450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:36.082865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.083555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.084442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:36.084442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.084442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:36.091397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:36.091887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:36.092633 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:36.093184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.093893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:36.094062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.095489 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:36.097460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.097889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:36.098301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:36.100073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.100812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.101602 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:36.102151 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.103848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.104701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.105547 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:36.107153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:41.040789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:41.042387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:41.057494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:41.059943 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.060450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.062995 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.066550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.067396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:41.078388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:41.078871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:41.079842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.080168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.080988 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:41.082439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:41.083149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:41.086259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.087075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Traceback (most recent call last):
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:41.087975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.088795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.089731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:41.091855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:41.092462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:41.093075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.093468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.094087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.094851 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:41.096583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:41.097426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:41.099139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.099990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.100911 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.102504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:41.103174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:46.041680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:46.043140 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:46.058963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:46.061197 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.062671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.063789 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.069606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.070567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:46.079528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:46.081212 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:46.081704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.081941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.083519 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:46.086519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.087378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:46.088685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.089139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.089675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:46.089675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.089675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:46.089675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.089675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.090862 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.092033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.092583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:46.093063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:46.093063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:46.093063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.093400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.093950 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:46.095291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.095706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:46.097182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.097663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:46.098124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.098124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:46.098124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:46.098124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:46.098124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.098386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:46.098507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.099038 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.100112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:46.100663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:51.042292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:51.043913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:51.061371 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:51.063684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.063971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.067755 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.070415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.071456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:51.081207 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:51.082715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:51.083924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.084238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.085125 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:51.085916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:51.087597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:51.088210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:51.090549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.091644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.093774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.094618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:51.095311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:51.095311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:51.095311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.095311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.095523 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:51.096609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.097143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:51.098306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.098945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:51.099738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.099738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:51.099738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:51.099738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:51.099738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.099989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:51.100168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.101022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.102831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:51.103493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:56.042769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:56.045552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:56.062799 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:56.064535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.064668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.065203 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.066259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.067081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:56.086684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:56.087174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:54:56.088068 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.088366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.091018 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:56.092859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.093216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:54:56.095138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.095522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.095960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:56.095960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.095960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:56.095960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:56.095960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:56.096655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.096964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Traceback (most recent call last):
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.098343 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:54:56.100018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:54:56.100746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:54:56.101258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:54:56.102970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.104061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:56.105251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.106096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.106636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.107174 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.109197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:54:56.109729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:01.091312 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:01.092082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:01.092082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:01.092918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:01.094485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.094711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.095303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:01.096750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.097416 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:01.098004 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:01.100801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.101963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:01.103801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:01.104030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.105131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.106065 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:01.109052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.109785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:01.113428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:01.113956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:01.118449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.119422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Traceback (most recent call last):
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.120354 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:01.122170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:01.125447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.125930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:01.126423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-63a03287-fa32-4abe-9329-8f3d4291382f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:01.127860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.129199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.130196 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.132312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.132965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:01.148699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:01.148897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.149229 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.150075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:01.151066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:06.092385 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:06.094168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:06.162357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:06.162746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:06.162972 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:06.163131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:06.164814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:06.166569 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:06.169534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:06.170061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.170443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.171826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.172026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.172774 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.178967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.179488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:06.180886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.181280 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:06.183679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.184088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:06.185349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:06.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.189157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.189943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:06.189943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.189943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:06.189943 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.191305 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:06.191683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:06.194528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:06.195301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:06.197937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.198845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:06.199734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.199734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.201066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:06.203493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.204138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.204138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:06.204138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.204138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:06.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:06.216609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Traceback (most recent call last):
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.217483 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.218437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:06.219293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:11.093081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:11.097529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:11.125715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.125896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Traceback (most recent call last):
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.126393 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.127200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.127960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:11.163762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:11.165765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:11.166066 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:11.166416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:11.167363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:11.168156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.168601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.169572 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:11.170511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:11.170758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.172666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.173421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:11.174315 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.174315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.174416 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:11.176012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:11.176767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:11.178376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.179193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.180875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.181388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.181734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:11.182199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.182460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.184050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:11.184518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:16.095903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:16.097800 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:16.148824 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.149095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.149867 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.152205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.153194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:16.166980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:16.167194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:16.168096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:16.168857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.169212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.170230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.170560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.171408 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.173070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.174007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.174793 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:16.176246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:16.177092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:16.178250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.179068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.179904 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:16.180708 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.180708 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:16.181698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.182146 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:16.183789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.184288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:16.184834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.184834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.185638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:16.186102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:21.097341 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:21.097960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:21.132628 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.132820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.133373 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.134082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.134840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:21.167765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:21.169151 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:21.169151 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:21.169936 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.170270 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.171243 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.174143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:21.175607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:21.175607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:21.175607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:21.175607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.175607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.177565 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:21.179772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.180505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:21.180926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.181485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.182025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:21.182025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.182025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:21.182025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.182025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.182372 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:21.183126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.183651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:21.185628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.186116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:21.186623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.189199 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.190848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:21.191482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:24.200228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=3365598d-9ad3-4100-9efc-eca47f477412, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85'}, gateway_chassis=[e0b7476b-2a10-4109-816e-acde7bc52c3d], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:79:3f:92', name='lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27', networks=['172.24.5.178/24', '2001:db8::13b/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=104358) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 02 05:55:26.097838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:26.099638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:26.138368 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.138756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.139864 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.140784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.141530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:26.168752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:26.169726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:26.170078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:26.170582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.171007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.171285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.172409 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.172967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:26.175010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.175716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.176581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:26.177954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:26.178756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:26.180085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.180660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.181191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:26.181191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.181191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:26.181191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.181191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.181362 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.181616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:26.182787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.183208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:26.184686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.185652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:26.186352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.186352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:26.186352 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.186352 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.186352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.186834 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.188136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.188705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:26.311772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=97467478-9d0b-4d15-8765-831116d9f615, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-335e4deb-892f-481a-a955-819809a93d31', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9', 'neutron:subnet_ids': 'f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:6c:c1:bb', name='lrp-712d1e26-a7fc-4876-83a8-f533191602a7', networks=['192.168.24.1/24'], options={}, peer=[], status={}) old= {{(pid=104358) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Apr 02 05:55:26.344363 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-335e4deb-892f-481a-a955-819809a93d31 synchronized; highest priority chassis 06dda8f5-c11d-4346-a529-a34c0fcd4ade
Apr 02 05:55:26.344928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '335e4deb-892f-481a-a955-819809a93d31', 'neutron:router_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9'}}) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.345413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-335e4deb-892f-481a-a955-819809a93d31, chassis=06dda8f5-c11d-4346-a529-a34c0fcd4ade, priority=1, columns={}) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:26.345830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.346574 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event Traceback (most recent call last):
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     match.run(event, row, updates)
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 86, in run
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     next(self.gen)
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     with self.create_transaction(
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     self.result = self.commit()
Apr 02 05:55:26.347249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise result.ex
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:26.347826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.event 
Apr 02 05:55:31.098628 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:31.100366 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:31.102381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=257 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:55:31.132882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.133520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Traceback (most recent call last):
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.134596 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.135773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.136533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:31.169439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:31.170470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:31.171173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.171505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.172106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:31.172389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.173252 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:31.174541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.175365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.176177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:31.176754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.177567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:31.178008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.178759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.179667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:31.180687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.181453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:31.181885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.182676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:31.183536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.183824 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.184764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:31.185107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:36.099454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:36.101504 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:36.137001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.137668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.138982 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.140100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.140680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:36.170537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:36.172245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:36.173080 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:36.174887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.175395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.175997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.176889 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:36.177805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:36.179556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.180106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:36.181244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.181549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.181925 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:36.182550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:36.184105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:36.184657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:36.185008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:36.186703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.187246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.187870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:36.187870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.187870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:36.189829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.189829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.189829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.189829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:36.189829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Traceback (most recent call last):
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.190163 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-43a843da-e465-44e2-b409-35aa6d0bfc6d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.192096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:36.192683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Traceback (most recent call last):
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.193307 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:36.194037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.194545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8ab85e98-a644-4603-9dc5-323045adbf67 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:36.195835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:36.196340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:36.196849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:36.196849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:40.838703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:40.849632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 05:55:40.849877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Number of inconsistencies found at create/update: networks=2, security_groups=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 05:55:40.850008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 05:55:40.886552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.887083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.887751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.888421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Traceback (most recent call last):
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.890367 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 05:55:40.890848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 05:55:40.891524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:40.892559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 05:55:40.892559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.892559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 05:55:40.892559 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 05:55:40.923198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.923709 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.924327 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:40.924690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Traceback (most recent call last):
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.925630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 05:55:40.926836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 05:55:40.927446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:40.928090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 05:55:40.928090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:40.928090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 05:55:40.928090 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Fixing resource 2bb785c6-f61b-4245-931e-c6a593e43827 (type: security_groups) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 05:55:40.980922 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.db.ovn_revision_numbers_db [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Successfully bumped revision number for resource 2bb785c6-f61b-4245-931e-c6a593e43827 (type: security_groups) to 9
Apr 02 05:55:40.981169 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Maintenance task: Synchronization completed (took 0.13 seconds)
Apr 02 05:55:41.100244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:41.101718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:41.137490 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.138049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.139314 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.140409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.141446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:41.171751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:41.172515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.172670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.173013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.173351 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:41.173596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.173786 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:41.174179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.176486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.177785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.178609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.179347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:41.180395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.180963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.181478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:41.181478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.181478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:41.182280 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:41.182998 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:41.183441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.184227 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:41.185367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:41.185761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:41.187086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.187530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:41.188133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.188133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:41.188133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:41.188133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.188302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:41.188440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.189063 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.190789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:41.191248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:46.100946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:46.102434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:46.138576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.144389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.145512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.146916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:46.172324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:46.173378 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.173986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.174340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.174983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.175523 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.178718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.179749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:46.180399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:46.180399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.180399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.180670 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:46.182211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.182696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:46.184202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.184670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.185170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:46.185170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.185170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:46.185170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:46.185170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:46.185630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.186080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.186930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:46.187450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.187744 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:46.189104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.189510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:46.191069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.191614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:46.192206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.192206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:46.192206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.192206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:46.192206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.193386 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.233084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:46.233945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:51.101550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:51.104408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:51.151578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.151906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Traceback (most recent call last):
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.152884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.153970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.155326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:51.172736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:51.174006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.174258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.174450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.175240 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:51.178124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.178989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:51.179843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:51.180063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:51.180933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.181141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.181753 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:51.183122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.183621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:51.185014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.185525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.186037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:51.186037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.186037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:51.186037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:51.186037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:51.186344 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.186577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.187145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:51.188638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:51.189122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:51.190588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.191012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:51.191511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.191511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:51.191511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:51.191511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.191635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:51.191894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.192282 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.193878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:51.194510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:56.103833 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:56.105320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:56.173600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:56.175631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.175631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.175631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.175991 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:56.177735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.178721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:56.180020 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:56.180363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:55:56.180780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.181088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.181674 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:56.183190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.185378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:56.186190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:56.186679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:56.189639 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.190140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.190907 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:55:56.192173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.193071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:55:56.193880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.194810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:56.196492 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.196790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.196790 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:56.196790 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.196790 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.197941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.198435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:55:56.944493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:55:56.944932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:55:56.945433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:01.104442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:01.106076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:01.138422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.138836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.139974 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.140885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.141635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:01.174424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:01.175891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.176501 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.176796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.178028 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:01.179610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.180095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:01.180612 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:01.180912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:01.181618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.182356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Traceback (most recent call last):
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.183576 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:01.184399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.185161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:01.186148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.186814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.187370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:01.187370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.187370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:01.187370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:01.187370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:01.188087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.188087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.188495 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:01.189542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.190323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:01.190626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.191086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:01.191587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.191587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:01.194716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:01.194982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:01.195488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.195896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:01.196123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.196917 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.198186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:01.199120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:06.105097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:06.106832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:06.138714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.139105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.140095 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.141049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.142118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:06.174876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:06.175736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.175916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.176057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.176714 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:06.178502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.179214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:06.180794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:06.181043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:06.181353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.181527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.182007 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:06.183167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.183946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:06.184717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.185625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.186801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:06.186801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.186801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:06.186801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:06.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:06.187838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.188188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Traceback (most recent call last):
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.189290 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:06.190770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.191187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:06.192961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.193470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:06.194024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.194024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:06.195069 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:06.195600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:06.196136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.196600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:06.196881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.197812 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.199450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:06.199902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:11.105843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:11.107333 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-3ed2ff82-f0e6-449f-a86f-83011daba2be None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:11.143355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.143653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-3ed2ff82-f0e6-449f-a86f-83011daba2be None None] Traceback (most recent call last):
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.144345 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-3ed2ff82-f0e6-449f-a86f-83011daba2be None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.145595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.146693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:11.175529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:11.176735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.177124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.177420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.178537 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:11.180307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.181408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:11.182417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:11.182417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:11.182417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.182774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.183695 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:11.184995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.185457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:11.186572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.187153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.187700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:11.187700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.187700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:11.187700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:11.187700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:11.187866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.188141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.188666 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:11.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.189954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:11.191004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.191553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:11.192110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.192110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:11.195525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:11.196062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:11.196465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.196761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:11.196955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.197645 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.199445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:11.200094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:16.106561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:16.108020 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:16.140549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.141048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.142127 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.143965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.145031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:16.176141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:16.177325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.177757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.178010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.179545 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:16.181106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.182134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:16.183178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:16.183178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:16.183178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.183178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.183615 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:16.185050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.185568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:16.186806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.187331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.187868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:16.187868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.187868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:16.187868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:16.187868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:16.188325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.188543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.189109 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:16.190465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.190938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:16.192128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.192643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:16.193162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.193162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:16.196008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:16.196581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:16.197048 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.197448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:16.197680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.198467 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.200157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:16.200709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:21.107322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:21.109829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:21.146545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.146971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Traceback (most recent call last):
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.147954 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.150146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.151071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:21.176924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:21.178006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.178330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.178621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.179396 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:21.181131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.181949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:21.183108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:21.183108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:21.183376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.183542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.184118 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:21.185491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.186251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:21.186745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.187522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.188423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:21.188423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.188423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:21.188423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:21.188423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:21.188706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.188815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.189380 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:21.190151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.190959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:21.191367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.192087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:21.192966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.192966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:21.196531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:21.196898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:21.197457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.197825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:21.198056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.199121 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.199746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:21.200632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:26.107977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:26.109617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:26.144290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.144864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.145971 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.146985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.147908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:26.177497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:26.178699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.179041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.179318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.180363 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:26.182151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.182941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:26.183777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:26.183777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:26.183777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.183965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.184774 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:26.185999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.186922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:26.187658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.188476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:26.189301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.189660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.190202 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:26.191547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.192126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:26.193294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.194003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:26.194514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.194514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:26.197199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:26.197968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:26.198566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.198932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:26.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.200031 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.202044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:26.202531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:31.108993 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:31.111607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:31.113507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=304,neutron:UPDATE=1 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:56:31.146557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.146787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.147486 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.148749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.149452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:31.177958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:31.178757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.178948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.179094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.179894 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:31.180813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.181580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:31.183181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:31.183421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:31.183722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.183896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.184383 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:31.187444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.187855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:31.189374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.189792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.190293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:31.190293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.190293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:31.190293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:31.190293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:31.190610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.190973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.191706 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:31.192632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.193095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:31.193730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.194175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:31.194688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.194688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:31.197649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:31.198105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:31.198510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.198843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:31.199053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.199765 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.201343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:31.201830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:36.110471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:36.112122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:36.144613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.145010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Traceback (most recent call last):
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.145884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.147018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.148014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:36.178642 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:36.179864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.180177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.180460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.181298 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.183007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.183793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:36.184566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:36.184566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:36.184566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.184884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.185492 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:36.186686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.187158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:36.188220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.188722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.189258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:36.189258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.189258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:36.189994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:36.190500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:36.191084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.191436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.192085 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:36.193038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.193505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:36.194204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.194732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:36.195192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.195192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:36.198253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Traceback (most recent call last):
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.205145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.205634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:36.206142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:41.111581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:41.113213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:41.154705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.155060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.155938 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.157014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.157866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:41.179238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:41.180461 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.180773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.181006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.183690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:41.184795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.185688 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:41.186259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.186259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.186259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:41.186259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.186259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:41.186509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.187389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:41.187736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.188067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.188452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:41.188452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.188452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:41.190445 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:41.190967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:41.191465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.191800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.192543 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:41.194051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.194408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:41.195900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.196408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:41.196913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.196913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:41.198641 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:41.199133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:41.199463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.199684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:41.199825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Traceback (most recent call last):
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.200449 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.201976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:41.202471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:46.112232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:46.114051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:46.141762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.141894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Traceback (most recent call last):
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.142424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.143248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.144039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:46.179904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:46.180986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.181324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.181676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.184338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:46.185429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.186322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.186322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:46.186322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.186322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:46.187749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:46.188440 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:46.189005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.189440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.190691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:46.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:46.193200 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:46.193704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.194154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:46.196241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.197045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.197836 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:46.198248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.198889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:46.200191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.201788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.202607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Traceback (most recent call last):
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.203006 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eeefdf19-16c7-43e0-a0a1-7793ec0fbfc9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:46.204964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:51.113010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:51.115695 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:51.150389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.150657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Traceback (most recent call last):
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.154447 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-89422ecf-56ec-49a4-9c4e-ba5c37df57c6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.157333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.158162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:51.180608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:51.181666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.181978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.182213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.183149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:51.184424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.185033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:51.188305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.190621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.191329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:51.192104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:51.192569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:51.193204 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:51.193652 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:51.193882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.194213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.194852 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:51.195638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.196508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:51.196886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.197629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:51.198743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.198743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:51.200822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:51.201412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:51.201676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.201981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:51.202189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.202788 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.203841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:51.204233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:56.113742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:56.117171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:56.153309 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.153428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:56.154808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:56.155191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.155541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:56.181149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:56.182080 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.182431 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.182656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.183476 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:56.185313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.186127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:56.188723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:56.189439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:56:56.189887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.190208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.190975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:56.191834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:56:56.192610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.193046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.193630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:56.193630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.193630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:56.193630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:56.193973 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:56.194477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.194837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.195612 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:56:56.196543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.196944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:56:56.197583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.197979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:56.198469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.198469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:56:56.201282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:56:56.202386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:56:56.202840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.203226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:56:56.203476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.204439 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.206539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:56:56.207131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:01.115311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:01.116831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:01.152041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.152685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Traceback (most recent call last):
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.153176 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.154296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.155224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:01.181573 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:01.182611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.182922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.183205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.184102 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:01.186007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.186857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:01.189159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:01.189850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:01.190409 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.190680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.191410 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:01.192405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.193159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:01.193686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.194365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.194874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:01.194874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.194874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:01.194874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:01.194874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:01.195354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.195855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.196766 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:01.198014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.198512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:01.199558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.200091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:01.200625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.200625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:01.201822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:01.202517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:01.202813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.203144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:01.203313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.203797 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.205439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:01.205923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:06.115918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:06.117924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:06.152197 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.152659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Traceback (most recent call last):
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.153646 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.154536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.155521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:06.182171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:06.183202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.183649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.183927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.184838 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:06.186555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.187411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:06.189858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:06.190506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:06.191066 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.191384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.192203 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:06.193550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.194295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:06.195096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.195910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.197186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.197639 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:06.198213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.198736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:06.199449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.199890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:06.200449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.200449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:06.202301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:06.202983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:06.203475 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.203872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:06.204095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.204877 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.205869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:06.206680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:11.116669 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:11.118259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:11.164054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.164054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Traceback (most recent call last):
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.164463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.165873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.166696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:11.182663 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:11.183678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.184025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.184253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.185079 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:11.186761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.187747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:11.190749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:11.191399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:11.192097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.192395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.193348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:11.194430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.195319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:11.196089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.196812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.197610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.197976 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:11.198744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.199300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:11.199768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.200319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:11.200889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.200889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:11.202881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:11.203660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:11.204087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.204489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:11.204723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Traceback (most recent call last):
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.205613 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b509c78f-6bc9-4631-bd99-dc3cbd9b7f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.207831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:11.208384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:16.117380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:16.118771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:16.154024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.154195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.154619 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.155402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.155918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:16.183371 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:16.184484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.184661 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.184753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.185526 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:16.187675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.188426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:16.191357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:16.191869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:16.192478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.192799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.193774 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:16.194666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.195374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:16.195729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.196327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.197055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:16.197055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.197055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:16.197055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:16.197055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:16.197459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.197721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:16.199596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.200225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:16.202025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.203376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:16.204797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.204797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:16.204797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:16.204797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:16.204797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.205178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:16.205395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.207557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:16.208297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:16.209001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:16.209001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:16.209001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:16.209001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:21.118232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:21.119302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:21.153816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.154474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.155499 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.156670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.157469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:21.184165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:21.185853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.186180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.186450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.187405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:21.188718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.189676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:21.191827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:21.192339 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:21.192941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.193225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.193922 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:21.194911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.195609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:21.196004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.196858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:21.197899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.198237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.198963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:21.199769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.200221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:21.200925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.201449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:21.202006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.202006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:21.204295 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:21.204735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:21.205191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.205648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:21.205933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.206589 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.207601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:21.208089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:26.118901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:26.120781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:26.158930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.159545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.160172 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.161718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.162676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:26.185129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:26.186532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.186846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.187100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.188019 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.189970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.190754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:26.192247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:26.192790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:26.193337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.193669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.194423 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:26.195814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.196318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:26.197563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.198009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.198505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:26.198505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.198505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:26.198505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:26.198505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:26.198678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.199007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.199748 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:26.201100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.201567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:26.202787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.203357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:26.203843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.203843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:26.204761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:26.205118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:26.205570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.205909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:26.206179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.206910 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.207912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:26.208463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:31.119604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:31.121242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:31.158306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.158657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.159588 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.160618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.161067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:31.185775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:31.186980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.187380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.187617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.188425 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.190042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.190891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:31.192761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:31.193382 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:31.193884 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.194179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.195000 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:31.197452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.198037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:31.199021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.199590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.200163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.200403 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:31.201103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.201633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:31.202113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.202575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:31.203076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.203076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:31.205184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:31.205527 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:31.205839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.206066 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:31.206226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.206860 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.208110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:31.208988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:36.120681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:36.121972 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:36.123826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=260 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:57:36.159708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.160175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.161108 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.162024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.162716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:36.186402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:36.187323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.187558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.187707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.188617 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:36.190474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.191738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:36.193750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:36.194123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:36.195446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.195980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.196583 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:36.198342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.198781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:36.200806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.201340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.201825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:36.201825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.201825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:36.202301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:36.202588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:36.204437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.204732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.205219 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:36.206445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.206902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:36.208015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.208488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:36.209002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.209002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:36.209220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:36.209582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:36.209875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.210082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:36.210224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.210711 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.212170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:36.212858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:41.121223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:41.123093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:41.163873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.164294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Traceback (most recent call last):
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.165438 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-661a7cc5-2027-4db7-9d5c-35d111c24920 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.167070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.168035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:41.186996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:41.188015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.188299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.188566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Traceback (most recent call last):
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.189453 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:41.191291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.192172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:41.194233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:41.194801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:41.195092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.195237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:41.197625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.198205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.198671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.199198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:41.202568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:41.203620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:41.204176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.204441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.205473 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:41.207623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.208061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:41.210211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.210707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:41.211181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.211181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:41.211528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:41.212063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:41.212765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.213129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:41.213390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.214285 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.215608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:41.216130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:46.121795 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:46.123407 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:46.159424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.159850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.160746 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.162039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.162905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:46.187560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:46.188529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.188847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.189017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.189870 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:46.191563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.192355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:46.194704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:46.194970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:46.195443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.195690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.196346 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:46.197289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.198210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:46.198801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.199321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:46.203095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:46.203568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:46.203961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.204168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.204683 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:46.206040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.206542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:46.207854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.208393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:46.208962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.208962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:46.212046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:46.212562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:46.213025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.213724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:46.213934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.214651 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.215850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:46.216715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:51.122543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:51.124165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:51.162724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.162918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.163622 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.164885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.165850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:51.188254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:51.189291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.189625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.189879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.190756 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:51.192557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.193423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:51.195012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:51.195155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:51.195618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.195908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.196627 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:51.197447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.197926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:51.198419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.198892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.199459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:51.199459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.199459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:51.203400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:51.203629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:51.204128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.204970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.205845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:51.207169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.207692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:51.209075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.209728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:51.210349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.210349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:51.212528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:51.212852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:51.213129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.213369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:51.213521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.213969 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.214762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:51.215316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:56.123226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:56.124660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:56.160574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.160980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.161817 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.162510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.163038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:56.188826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:56.189677 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.189938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.190160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.190924 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:56.192561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.193084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:56.195472 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:56.196181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.197616 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:56.198680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.199422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:57:56.199821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.200836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.201842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:56.201842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.201842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:56.203691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:56.204280 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:56.204730 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.204959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.205510 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:57:56.207053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.207999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:57:56.208827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.209792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:56.210906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.210906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:57:56.213039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:57:56.213560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:57:56.214211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.214606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Traceback (most recent call last):
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.216226 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-60f227d0-7653-4ea5-838c-e3df6ff09528 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.217773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:57:56.218842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:01.123888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:01.126044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:01.166571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.166920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Traceback (most recent call last):
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.167856 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2fe42eaa-963e-4e1f-9453-621617892924 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.169112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.170262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:01.189529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:01.190714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.191047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.191301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.192348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:01.193613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.194585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:01.196031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:01.196454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:01.196942 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.197162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.197821 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:01.198830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.200001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:01.200821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.201802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:01.204046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:01.204397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:01.205102 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.205701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.206657 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:01.207861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.208254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:01.209560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.209997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:01.210383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.210383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:01.213570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:01.214305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:01.214516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.214784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:01.214938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.215528 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.216542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:01.217220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:06.124615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:06.126196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:06.159782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.160141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.160930 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.161984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.162732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:06.190356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:06.191282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.191554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.191823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.192570 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:06.194418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.195146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:06.196528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:06.196916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:06.197577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.198058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.198994 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:06.200281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.200807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:06.201568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.202538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:06.202538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.202538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:06.204541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:06.204871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:06.205556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.205778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.206483 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:06.207753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.208402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:06.209656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.210097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:06.210666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.210666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:06.213944 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:06.214367 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:06.214692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.214914 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:06.215073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.215891 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.216956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:06.217730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:11.125300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:11.127162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:11.161192 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.161640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.162540 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.163386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.164242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:11.191025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:11.192186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.192521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.192757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:11.195870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:11.196704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:11.197496 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:11.198114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.198198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.198948 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:11.199815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.200189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:11.200849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.201284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.201742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:11.201742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.201742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:11.204983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:11.205282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:11.205747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.206079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.206884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:11.208118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.208878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:11.209798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.210586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:11.211436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.211436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:11.214434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:11.214927 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:11.215384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.215715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:11.215923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.216697 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.218456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:11.219026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:16.126041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:16.127718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:16.163462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.163462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.164256 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.165212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.166145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:16.191699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:16.192819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.193167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.193442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.194415 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:16.196513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.197374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:16.198227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:16.198227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:16.198883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.199132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Traceback (most recent call last):
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.199930 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:16.201690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.202430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f14e9bcb-2242-41a4-aa2c-7250c5f860ca None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:16.202836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.203582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.204414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:16.204414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.204414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:16.205443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:16.205747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:16.206237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.206604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.207251 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:16.208520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.208980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:16.210104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.210590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:16.211096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.211096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:16.214790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:16.215669 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:16.216134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.216503 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:16.216713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.217527 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.219453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:16.220256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:21.127484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:21.129093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:21.168854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.169340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.170233 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.171293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.171903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:21.192210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:21.193164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.193507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.193841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.194845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:21.196476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.196946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:21.198040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:21.198462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:21.198932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.199219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.200017 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:21.201473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.201994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:21.203811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.204298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.204800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:21.204800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.204800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:21.205784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:21.206064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:21.206436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.206658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.207126 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:21.208023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.208471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:21.209027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.209460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:21.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:21.215701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:21.216391 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:21.216873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.217237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:21.217494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.218294 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:21.220722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:26.128220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:26.129537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:26.160091 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.160469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.161173 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.162066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.163008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:26.192817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:26.193721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.193903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.194040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.194690 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:26.195730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.196533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:26.198459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:26.198756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:26.199107 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.199289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.199773 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:26.200690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.201556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:26.202035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.202888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.203614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:26.203614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.203614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:26.206135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:26.206461 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:26.206722 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.206955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.207365 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:26.208038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.208559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:26.208997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.209528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:26.210077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.210077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:26.216325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:26.216925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:26.217403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.217727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:26.217937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.218706 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.219930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:26.220835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:31.129654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:31.130842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:31.174304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.174832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.175862 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.177082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.177857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:31.193394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:31.194403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.194822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.195068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Traceback (most recent call last):
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.195876 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-42bb45c8-2433-40b2-afd9-070262274b1c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:31.197520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.198258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:31.199115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:31.199115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:31.199478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.199698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.200248 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:31.201195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.201839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:31.202374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.202859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.203474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:31.203474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.203474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:31.206603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:31.207082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:31.207473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.207750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Traceback (most recent call last):
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.208330 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:31.209526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.210013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f16f7d93-9896-4cc4-82a3-406bd7614c69 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:31.211456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.211959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:31.212553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.212553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:31.216856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:31.217634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:31.218023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.218247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:31.218411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.219052 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.221699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:31.222500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:36.130359 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:36.132058 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:36.133686 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:58:36.166776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.167201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.168077 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.168942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.169575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:36.204086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:36.204196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:36.204945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:36.205218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.205415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.205526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.206202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.206346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Traceback (most recent call last):
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.206882 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.207332 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:36.207509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5ebbca79-1c9e-487c-a4c8-0ead9738a1b7 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:36.208489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.208858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:36.209237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:36.209602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:36.210357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.210708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.211141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:36.211141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.211141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:36.211141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.211141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.211360 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:36.211931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.212429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:36.214410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.214913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:36.215498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.215498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:36.217187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:36.217795 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:36.218277 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.218659 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:36.218885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Traceback (most recent call last):
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.219787 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-104bd1ca-e9ad-4f60-8a1f-094afac3d2db None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.221876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:36.222433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:41.131061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:41.132598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:41.167134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.167393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.168130 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.169035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.169519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:41.204966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:41.205147 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:41.243322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:41.245494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:41.245951 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:41.246084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.246295 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.246461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.247313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:41.247766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.248561 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:41.251501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.252030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:41.252592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:41.252592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.252592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:41.254158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:41.255135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.255508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:41.256317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:41.256920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:41.257844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.258240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.258684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:41.258684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.258684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:41.259117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.259572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.260561 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.261036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:41.261414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:46.131770 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:46.133307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:46.167854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.168150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.169182 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.170342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.171239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:46.205811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.226392 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:46.227025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.227802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:46.228678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:46.229404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:46.230153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.230902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.231758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:46.247247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:46.250490 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:46.259007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:46.260380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:46.305202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.305792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Traceback (most recent call last):
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.307147 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:46.308816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:46.309702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8982a376-8d21-4c06-8721-60d776c6036b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:46.310310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.311052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.311881 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.312447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:46.313173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:51.132256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:51.133429 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:51.168898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.169214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.169855 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.170774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.171240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:51.208426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:51.209983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.210398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.210689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.210913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:51.211443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:51.211756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.211902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Traceback (most recent call last):
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.213215 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:51.215119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.215807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-602e238f-a3f8-4f45-a4a0-4db248ddcc3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:51.217284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.218576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.219303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.220069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.220853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:51.259088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:51.259601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:51.260045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.260249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.260866 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:51.261245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:51.263028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:51.263848 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:51.264726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.265579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.266450 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.267488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:51.268697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:56.132920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:56.134597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:56.171913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.172088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.172806 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.173867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.174797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:56.209022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:56.210086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.210216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.210413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Traceback (most recent call last):
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.211246 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:56.211740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:56.212953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.214018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.215353 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:56.215955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.216626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:58:56.216890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.217362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.217938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:56.217938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.217938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:56.259562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:56.260177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:56.260683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.260948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.261614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:58:56.263031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:58:56.263966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:58:56.265613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.266365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:58:56.267205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.267963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.269519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:58:56.269989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:01.158528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:01.158528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:01.171681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.172011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.172860 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.174129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.175006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:01.209610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:01.210768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.211160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.211554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.212537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.213251 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:01.213692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.215944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.216815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Traceback (most recent call last):
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.217602 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:01.219047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.219850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-adf94866-3b92-4254-903a-1b54857224b8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:01.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.222060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.222921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:01.222921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.222921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:01.259960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:01.260422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:01.260774 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.261013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.261611 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:01.262924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.263605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:01.265106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.265890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:01.266738 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.267248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.267248 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:01.267248 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.267248 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.268256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:01.268990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:06.134430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:06.135778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:06.164108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.164539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.165388 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.166538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.167454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:06.210144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:06.211153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.211494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.211726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.212682 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:06.214576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.215360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:06.216179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:06.216179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:06.216179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.216443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.217302 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:06.218733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.219553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:06.223371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.223857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.224408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:06.224408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.224408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:06.260463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:06.261888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:06.262493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.262838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.263693 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:06.264707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.265159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:06.266158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.266651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:06.267106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.267106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:06.267106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:06.267106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:06.267540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.268202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:06.268463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.269127 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.270117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:06.270616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:11.135762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:11.138083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:11.172574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.172938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.173794 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.174851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.175471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:11.210730 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:11.211776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.212136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.212383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.213236 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:11.215169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.216035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:11.216985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:11.216985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:11.216985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.216985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.217881 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:11.219379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.220262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:11.220911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.221869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.222780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:11.222780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.222780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:11.262163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:11.263232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:11.264786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.265155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.266163 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:11.267985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.273207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.273783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:11.274802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.275696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:11.276370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:11.277053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:16.136630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:16.138180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:16.174375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.174894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.175921 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.176850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.177700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:16.211236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:16.212474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.212771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.213006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.214021 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:16.215382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.216214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:16.217076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:16.217076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:16.217076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.217375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.218087 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:16.219402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.219895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:16.220901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.221435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.221910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:16.221910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.221910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:16.262844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:16.263566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:16.264162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.264555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.265586 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:16.267040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.267990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:16.268610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.270235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:16.271648 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.272201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.272201 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:16.272201 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.272201 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.272676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:16.273663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:21.137360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:21.139032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:21.178924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.179201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.180170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.181246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.216622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.217167 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:21.217529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.217975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:21.218578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:21.218578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:21.218578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.218685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.219373 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:21.220682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.221148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:21.222152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.222635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.223230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:21.223230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.223230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:21.263552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:21.263940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:21.264552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.264952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.265676 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:21.266407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.266817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:21.267153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.267638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:21.268201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.268201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:21.269257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:21.269690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:21.270061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.270443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:21.270671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.271333 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.272862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:21.273653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:26.137987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:26.139622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:26.173915 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.174343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.175215 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.176172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.177093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:26.212465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:26.213639 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.213975 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.214253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.215238 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:26.217077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.217867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:26.218822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:26.218822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:26.218822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.218822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.219049 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:26.219844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.220717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:26.221059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.222136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.222758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:26.222758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.222758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:26.264386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:26.265873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:26.265873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.265873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.266117 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:26.267088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.267724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:26.268160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.268717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:26.269310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.269310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:26.269636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:26.269948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:26.270189 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.270433 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:26.270582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.271018 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.272001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:26.272550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:31.139808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:31.141386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:31.177888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.177888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.178390 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.179851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.180280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:31.214580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:31.216760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.216760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.216760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.217135 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:31.219056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.219756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:31.220546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:31.220546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:31.221040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.221504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.222487 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:31.223162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.223943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:31.224358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.225094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.225997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:31.225997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.225997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:31.264917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:31.265629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:31.267139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.267139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.267814 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:31.269352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.270302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:31.272797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.273476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:31.274015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.274015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:31.274015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:31.274126 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:31.275417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.275417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:31.275417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Traceback (most recent call last):
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.275604 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.276826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:31.277420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:36.141023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:36.143064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:36.144853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 05:59:36.175454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.175724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Traceback (most recent call last):
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.176693 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.177873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:36.215125 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:36.216411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.216766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.217082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.218252 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:36.220035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.221003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:36.221872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:36.221872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:36.222148 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.222478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.223187 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:36.224479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.224990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:36.225476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.225963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.226566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:36.226566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.226566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:36.265485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:36.265880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:36.266348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.267374 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:36.268538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.269223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:36.270100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.270833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:36.271623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.271623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:36.273917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:36.274696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:36.275673 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.275985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:36.276227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Traceback (most recent call last):
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.277086 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2af5bc1e-a26f-4dd0-9a10-f3bce6b24f44 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.278488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:36.279084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:41.141770 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:41.142723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:41.176158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.176621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Traceback (most recent call last):
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.177562 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.178802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.180861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:41.215897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:41.217009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.217336 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.217570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.218530 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:41.220293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.220731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:41.221455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:41.221988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:41.222609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.222922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.223739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:41.225073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.225813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:41.226897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.227624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.228394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:41.228394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.228394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:41.266014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:41.266255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:41.266863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.267369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.268359 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:41.269594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.269913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:41.271444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.271896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:41.272259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.272259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:41.274243 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:41.274920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:41.275322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.275510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:41.275622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Traceback (most recent call last):
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.276126 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.277960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:41.278679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:46.142311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:46.145263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:46.178828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.179050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.180297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.181551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:46.216520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:46.217627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.217868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.218068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:46.220811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.221640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:46.222588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:46.222588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:46.223134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.223457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.224221 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:46.225477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.226611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:46.227188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.227881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.228449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:46.228449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.228449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:46.266549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:46.266989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:46.267479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.267845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.268649 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:46.269813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.270825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:46.271513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.271989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:46.272627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.272627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:46.274723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:46.275257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:46.275626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.275840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:46.275989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Traceback (most recent call last):
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.276650 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6601ae95-bdf5-46ab-a07b-89c21a170127 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.278391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:46.279057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:51.142885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:51.143864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:51.178473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.178693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Traceback (most recent call last):
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.179371 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.180468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.180964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:51.217093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:51.218159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.218434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.218594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.219230 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:51.220507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.221171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:51.222564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:51.222869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:51.223242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.223460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.225423 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:51.226689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.227160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:51.228395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.229308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:51.229308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.229308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:51.267060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:51.267623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:51.268314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.268815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.269797 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:51.271012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.271797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:51.272792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.273980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:51.274781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.274781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:51.275924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:51.275924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:51.276340 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.276594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:51.276754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.277357 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.278566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:51.279044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:56.143622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:56.145963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:56.180816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.181086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.181806 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.183569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.184196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:56.217684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:56.218807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.219065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.219283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.220177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:56.222109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.222930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:56.223713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:56.223713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 05:59:56.223994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.224262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.224920 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:56.225861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.226765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 05:59:56.227221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.228038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.228967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:56.228967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.228967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:56.267592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:56.267839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:56.268551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.269025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.269942 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 05:59:56.270519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.271207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:56.272063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.272978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 05:59:56.275650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 05:59:56.276476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 05:59:56.276919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.277221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 05:59:56.277446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.278207 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.280035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 05:59:56.280564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:01.144363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:01.145693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:01.183470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.184031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Traceback (most recent call last):
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.185431 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae23f02b-8132-41e0-95d0-413a4511fc62 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.186329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.186807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:01.218160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:01.219145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.219479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.219711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.221547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:01.222058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.222575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.222575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:01.222575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.222575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:01.223448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:01.223977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:01.224574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.224858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.225654 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:01.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.227363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:01.228831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.229241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.229694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:01.229694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.229694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:01.268109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:01.268485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:01.268925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.269207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.269769 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:01.270516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.270912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:01.271529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.271938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:01.272403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.272403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:01.276099 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:01.276777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:01.277148 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.277410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:01.277559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.278098 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.279765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:01.280189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:06.145110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:06.147455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:06.179422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.180258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.181287 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.182640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.183688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:06.218769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:06.220088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.220739 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.220739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.221559 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.223244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.224007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:06.225162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:06.225162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:06.225162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.225162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.226391 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:06.227200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.228389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:06.229062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.229969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:06.268764 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.353789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.354581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.355459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:06.356996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:06.357700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:06.358531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:06.359552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:11.146369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:11.147823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:11.177357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.177621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.178295 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.179086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.180422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:11.219711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:11.221702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.222122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.222445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.223102 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.224988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.225855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:11.226558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:11.226558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:11.226558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.226666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.227201 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:11.228163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.228611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:11.229150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.229612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.230076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:11.230076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.230076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:11.269498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:11.270044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:11.270728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.272007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.272517 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:11.273405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.274122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:11.274517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.275190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:11.276092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.276092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:11.277051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:11.277465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:11.277749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.277968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:11.278114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.278630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.279689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:11.280255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:16.146886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:16.147768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:16.186009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.186340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.186951 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.187845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.188901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:16.220320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:16.221450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.221703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.221877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.222726 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.223643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.224246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:16.225901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:16.226773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:16.227131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.227395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.227915 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:16.228935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.229864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:16.230335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.231177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.233012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:16.233012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.233012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:16.270176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:16.270710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:16.271258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.271630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.272214 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:16.273233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.274057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:16.274808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.275660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:16.277523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:16.278081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:16.278600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.279099 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:16.279377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.279963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.280972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:16.281475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:21.147502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:21.149373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:21.182842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.183151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.183785 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.184797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.185578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:21.221060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:21.221986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.222419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.222419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.222888 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.223863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.225236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:21.228289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:21.228810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:21.229170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.229358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.229815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:21.231019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.231489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:21.232682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.233506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.234085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:21.234085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.234085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:21.270906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:21.271449 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:21.271905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.272171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.272812 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:21.274244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.274913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:21.276624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.277299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:21.278182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.278182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:21.278182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:21.278348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:21.279299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.279299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:21.279299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.279701 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.280642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:21.281838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:26.148414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:26.150978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:26.186177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.186420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.187137 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.188129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.189489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:26.221709 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:26.223106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.223468 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.223700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.224607 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.225743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.227381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:26.228834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:26.229172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:26.229555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.229752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.230325 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:26.232029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.232581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:26.233548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.234349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.234874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:26.234874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.234874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:26.271416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:26.272035 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:26.272710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.273091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.273834 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:26.274565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.275056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:26.275317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.275791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:26.276303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.276303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:26.278630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:26.278830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:26.279093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.279353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:26.279505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.279986 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.281126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:26.281622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:31.149699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:31.151607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:31.188715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.188905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.189670 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.190936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.191951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:31.222577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:31.223955 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.224524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.224896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.226013 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.228010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.229291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:31.229896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:31.230411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:31.230698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.230954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.231680 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:31.233976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.234536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:31.235215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.235797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.236472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:31.236472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.236472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:31.272568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:31.273590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:31.274297 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.274745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.275521 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:31.276165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:31.277663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.278465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:31.278868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:31.279288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:31.279542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.279756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:31.279908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.280401 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.281403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:31.281877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:36.150203 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:36.151143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:36.156223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=241 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:00:36.184761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.184761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.185259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.186118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.188809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:36.223110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:36.224541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.224916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.225256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.226348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.227604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.228093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:36.229775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:36.230065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:36.230404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.230637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.231096 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:36.232419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.233339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:36.234176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.235040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.235942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:36.235942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.235942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:36.273406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:36.273687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:36.274553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.275374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.276260 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:36.277792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.278319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:36.279521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.280001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:36.280548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.280548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:36.280548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:36.280548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:36.281184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.281611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:36.281820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.282459 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.283918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:36.284436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:40.840146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:40.852076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:00:40.852223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=2, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:00:40.852355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:40.889986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.907023 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.907540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.907861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.908379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:40.908379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.908379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:40.908379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:40.923542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.923934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.924335 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.924558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.925340 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.926528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.927016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.927682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:40.927682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.927682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:40.927682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:40.953063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.953518 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.954125 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:40.954461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.955476 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.956395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:40.956979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:40.957710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:40.957710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:40.957710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:40.957710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:41.032630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.033223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.033877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.034176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.035647 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.036620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.037018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.037428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:41.037428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.037428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:41.037428 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource d57e70ee-18b9-4de6-bb6a-0e0bce5058be (type: security_groups) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:41.150938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:41.152438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:41.183862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.184260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.185354 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.186390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.187425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.268138 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.268993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.269884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.271084 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:41.271777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.272656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:41.273134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.273629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:41.273904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:41.274719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:41.275292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.275679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.276638 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:41.277851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.278246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:41.279104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.279550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:41.280021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.280021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:41.280416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:41.280956 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:41.281263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.281624 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.281843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.282533 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.284627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.285145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:41.302681 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.db.ovn_revision_numbers_db [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Successfully bumped revision number for resource d57e70ee-18b9-4de6-bb6a-0e0bce5058be (type: security_groups) to 10
Apr 02 06:00:41.303107 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource 27ebe294-06c2-4573-bfa7-ffdebd09c27e (type: security_groups) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:41.420486 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.db.ovn_revision_numbers_db [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Successfully bumped revision number for resource 27ebe294-06c2-4573-bfa7-ffdebd09c27e (type: security_groups) to 15
Apr 02 06:00:41.420683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:41.522039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.522466 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.522693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.523004 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.523164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.524297 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.524870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:00:41.528501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:41.529483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:41.530057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:00:41.658878 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.659356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.659946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:41.660332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Traceback (most recent call last):
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.661252 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.662727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:00:41.663482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:41.664048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:00:41.664048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:41.664048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:00:41.664048 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-52cc82b2-10cf-4321-a90e-6304f018ffee None None] Maintenance task: Synchronization completed (took 0.81 seconds)
Apr 02 06:00:46.151589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:46.153134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:46.185712 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.185956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.186584 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.187572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.188762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:46.225645 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:46.226642 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.226785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.227026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.227759 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.229359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.229943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:46.230557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:46.231677 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:46.232249 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.232567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.233254 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:46.234668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.235772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:46.236202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.237031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.237968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:46.237968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.237968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:46.274696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:46.275375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:46.276705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.276961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Traceback (most recent call last):
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.277837 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:46.279114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.279847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-b8efea8e-b827-406e-ac21-9e9137dd686c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:46.281046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.281772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.282710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:46.283037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.283732 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.284509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:46.285003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:51.152494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:51.154116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:51.195154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.195528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.195906 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.196936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.198092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:51.225019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:51.226713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.226713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.226959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.227669 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.228475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.229870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:51.231041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:51.231326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:51.231966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.232380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.233259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:51.234135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.235192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:51.235614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.235944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:51.275345 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:51.275831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:51.276653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.277058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.277969 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:51.279732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.280819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:51.283230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.283949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:51.284421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.284421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:51.284421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:51.284421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:51.284813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.285010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:51.285259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.286058 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.286972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:51.288005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:56.153532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:56.156289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:56.184739 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.185172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.186022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.187234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.188002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:56.225819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:56.227210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.227554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.227838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.228868 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.230756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.231629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:56.232386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:56.232386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:00:56.232386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.233392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.233812 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:56.234619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.235396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:00:56.235765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.236526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.237568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:56.237568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.237568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:56.275918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:56.276462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:56.277097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.277633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.278438 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:00:56.279422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.279817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:00:56.280538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.280958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:56.281547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.281547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:00:56.284100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:00:56.284458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:00:56.288609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:00:56.289019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:00:56.289656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:01.155106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:01.156456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ceb9d4dd-16c3-49f4-b92d-66a980b1d91f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:01.190583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ceb9d4dd-16c3-49f4-b92d-66a980b1d91f None None] Traceback (most recent call last):
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.192697 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ceb9d4dd-16c3-49f4-b92d-66a980b1d91f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.193080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.193713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:01.226477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:01.228929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.229259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.229534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.230468 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.231665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.232145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:01.232642 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:01.232642 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:01.232776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.232932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.233363 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:01.234187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.234821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:01.235762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.236361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.236980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:01.236980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.236980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:01.276551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:01.277534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:01.278400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.278660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.279524 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:01.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.282890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:01.283770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.286673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.287386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.287709 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.288993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:01.289736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:06.155569 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:06.157721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:06.192567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.192946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.193874 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.195351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.195797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:06.227180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:06.228575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.228849 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.229081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.229955 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.231440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.232433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:06.233299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:06.233299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:06.233727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.233727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.234513 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:06.235234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.236392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:06.237218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.237983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:06.277293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:06.278003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:06.278707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.279143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.279932 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:06.280919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.281748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:06.282237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.283038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:06.283919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.283919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:06.285216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:06.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:06.286315 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.286766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:06.287068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.287880 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.289485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:06.290027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:11.156407 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:11.157625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:11.195546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.195980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.196701 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.197765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.198252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:11.227814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:11.229159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.229549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.229549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.230282 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.232654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.233237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:11.233859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:11.233859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:11.233859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.233859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.234067 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:11.234771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.235593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:11.237929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.239526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.240670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:11.240670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.240670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:11.278123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:11.278632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:11.279447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.279611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.280385 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:11.281898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.282460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:11.283356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.283873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:11.284385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.284385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:11.285580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:11.286350 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:11.286845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.287207 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:11.287484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.288253 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.290002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:11.291091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:16.157108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:16.158889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:16.194970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.195128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.195626 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.196398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.196967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:16.228369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:16.229647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.230098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.230436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.231163 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.232488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.232950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:16.233505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:16.233693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:16.234182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.234480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.235220 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:16.236253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.237147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:16.237813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.238384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.238977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:16.238977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.238977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:16.279121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:16.279121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:16.279894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.280209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.281133 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:16.282749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.283189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:16.284364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.284819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:16.285313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.285313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:16.286031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:16.286796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:16.287155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.287389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:16.287536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.288129 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.289864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:16.290358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:21.157835 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:21.159579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fdfd94e2-edcc-4196-93ac-a5c0b27b49a1 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:21.188465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.188862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fdfd94e2-edcc-4196-93ac-a5c0b27b49a1 None None] Traceback (most recent call last):
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.189756 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fdfd94e2-edcc-4196-93ac-a5c0b27b49a1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.190641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.191468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:21.229127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:21.230292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.230660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.230909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.231855 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.233569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.234034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:21.234523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:21.234523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:21.234523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.234523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.234863 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:21.235588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.236075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:21.236625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.237171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.238056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:21.238056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.238056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:21.279135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:21.280126 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:21.280539 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.280887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.284304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.285169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:21.286604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.287603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:21.288292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.288292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:21.288569 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:21.288926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:21.289529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.289888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:21.290119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:21.291670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:21.292034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:21.292402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:26.158620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:26.159860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:26.194919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.194919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.195259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.197007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.197412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:26.229795 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:26.231030 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.231492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.231746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.232545 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.233424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.234133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:26.235001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:26.235001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:26.235402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.235733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.236635 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:26.237898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.238882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:26.239462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.240179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.241119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:26.241119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.241119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:26.279887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:26.280415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:26.280848 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.281130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.282500 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:26.283851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.284394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:26.285849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.289696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.290589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:26.290909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.291232 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.292779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:26.293622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:31.159316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:31.160652 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:31.199495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.199839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.200647 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.201767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.202960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:31.230423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:31.231372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.231682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.231920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.232766 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.233794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.234561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:31.235343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:31.235343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:31.235477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.235780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.236433 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:31.237682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.238231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:31.239378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.239870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.240394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:31.240394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.240394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:31.280462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:31.281161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:31.281929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.282363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.283149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:31.284044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.284588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:31.285132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.285664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:31.286154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.286154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:31.289537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:31.289911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:31.290377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.290762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:31.290996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.291825 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.292910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:31.293427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:36.159679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:36.161935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:36.173447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=472,neutron:UPDATE=2 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:01:36.205585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.205777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.206451 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.207608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.208653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:36.230979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:36.231797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.231797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.231973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.232399 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.233107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.233934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:36.235023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:36.235181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:36.235377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.235508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.235876 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:36.236501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.237657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:36.238399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.239164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:36.280872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:36.281516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:36.282032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.282413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.286675 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:36.288152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.289250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:36.291515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.292088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.292587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:36.292906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:36.293588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:36.294663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:36.294663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:36.294663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:36.294663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:41.160790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:41.162775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-16857c8f-b8f1-4511-a742-fe2be57c9a51 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:41.198785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.198785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-16857c8f-b8f1-4511-a742-fe2be57c9a51 None None] Traceback (most recent call last):
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.199087 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-16857c8f-b8f1-4511-a742-fe2be57c9a51 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.200122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.200986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:41.231500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:41.232468 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.232716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.232960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.233852 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.235611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.236441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:41.237251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:41.237251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:41.237251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.237251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.238517 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:41.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.239972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:41.241053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.242299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:41.281537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:41.282123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:41.282686 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.283010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.283679 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:41.284987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.285731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:41.286844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.287700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:41.288523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.288523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:41.290402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:41.290700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:41.290991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.291236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:41.291424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.291945 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.292946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:41.293451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:46.161471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:46.163006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:46.192129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.192401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.193108 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.194011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.195294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:46.232075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:46.233290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.233578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.233805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.234520 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.235561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.236453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:46.237347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:46.237347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:46.237834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.238144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.238935 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:46.264026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.264862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:46.265868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.266700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:46.282031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:46.282708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:46.283676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.284102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.285099 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:46.286016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.286712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:46.287095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.287967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:46.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:46.290777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:46.291475 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:46.291995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.292453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:46.292678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.293509 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.295167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:46.295664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:51.162069 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:51.163751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:51.199514 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.199695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.200104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.200895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.201702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:51.232687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:51.234531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.234845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.235096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.236250 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.237526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.238661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:51.239924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:51.239924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:51.239924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.239924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:51.242521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.243366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:51.246002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.246401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.246732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:51.246732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.246732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:51.282638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:51.283164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:51.284103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.284679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.285691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:51.286606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.287002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:51.287730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.288326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:51.288868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.288868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:51.291240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:51.291773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:51.292430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.292911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:51.293216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.295519 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.296996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:51.298534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:56.162627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:56.164426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:56.199743 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.199976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.202488 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.203854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.204190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:56.233776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:56.235165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.235426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.235592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.236513 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.237705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.238970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:56.239474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:56.239474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:01:56.239705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.239884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.240422 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:56.241330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.241739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:01:56.242404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.243053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.243749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:56.243749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.243749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:56.283139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:56.283731 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:56.284300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.284522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.285069 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:01:56.286388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.286819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:01:56.288046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.288492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:56.288954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.288954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:01:56.291689 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:01:56.292605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:01:56.292989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.293149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:01:56.293249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.293844 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.296040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:01:56.296742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:01.163223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:01.165104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:01.197516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.197516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.197898 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.199024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.200054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:01.234585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:01.236880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.236880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.236880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.237201 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.239100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.239908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:01.240963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:01.241472 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:01.242775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.242775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.242992 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:01.244009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.244562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:01.245814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.246487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.247033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:01.247033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.247033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:01.283814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:01.284675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:01.285363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.286634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.286917 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:01.288197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.289046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:01.290003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.290870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:01.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:01.292162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:01.292964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:01.293488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.293844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:01.294185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.294940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.296964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:01.297522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:06.163945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:06.165323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:06.205403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.206296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Traceback (most recent call last):
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.207201 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.208952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.209422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:06.235205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:06.237103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.237434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.237434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.238181 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.240693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.242444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:06.242920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:06.242920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:06.245162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.245424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.246058 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:06.246963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.248526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:06.249215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.249773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:06.284676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:06.285426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:06.286137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.286460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.287166 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:06.288765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.289486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:06.290861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.291645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:06.292416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.292416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:06.292639 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:06.293561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:06.294736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.294736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:06.294736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.295602 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.296959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:06.297819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:11.164537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:11.165841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:11.196563 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.196563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Traceback (most recent call last):
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.197494 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.198289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.199112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:11.235958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:11.237397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.237787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.238058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.239134 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.241115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.241990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:11.243002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:11.243540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:11.244442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.244687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.245378 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:11.246624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.247405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:11.247920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.248658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.249659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:11.249659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.249659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:11.285364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:11.285960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:11.287426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.287631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.288260 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:11.289868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.291185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:11.292213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.292936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:11.293441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.293441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:11.293531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:11.294116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:11.294429 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.294535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:11.294644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.295206 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.296737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:11.297437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:16.165310 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:16.167097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:16.196320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.196640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.197308 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.198348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.199220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:16.236551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:16.237604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.237837 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.237977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.238678 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.240736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.241296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:16.243590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:16.244101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:16.244675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.244978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.245731 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:16.246917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.247487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:16.247747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.248210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.248777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:16.248777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.248777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:16.285941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:16.286522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:16.287100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.287551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.288248 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:16.289024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.289732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:16.290115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.290918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:16.291759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.291759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:16.294034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:16.294559 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:16.294897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.295281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:16.295562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.296978 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.299111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:16.300068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:21.166422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:21.169622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:21.207567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.208028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.209308 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.211812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.212804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:21.237006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:21.237891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.238107 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.238261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.239225 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.240104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.240916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:21.244025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:21.244386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:21.245394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.245679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.246425 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:21.247604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.248507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:21.249066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.249573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.250062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:21.250062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.250062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:21.286579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:21.287093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:21.287625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.287897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.288500 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:21.289639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.290351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:21.291004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.291763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:21.292561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.292561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:21.294370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:21.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:21.295337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.295582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:21.295759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.296323 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.297489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:21.297977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:26.167106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:26.169898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:26.201499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.201706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Traceback (most recent call last):
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.202382 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.203918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.204422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:26.237493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:26.238561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.238761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.238889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.239548 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.241405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.242186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:26.244417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:26.245101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:26.245675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.245905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.246766 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:26.248164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.249074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:26.249745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.250574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.251482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:26.251482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.251482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:26.287109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:26.287453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:26.288003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.288398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.289092 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:26.289946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.290439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:26.291033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.291478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:26.291992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.291992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:26.294772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:26.295447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:26.296326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.296326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:26.296326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.297511 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.299371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:26.300262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:31.168699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:31.169754 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:31.207153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.207461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Traceback (most recent call last):
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.208170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6bc8b929-e7aa-44e2-a586-8a42022989d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.209735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.211345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:31.238063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:31.239324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.239645 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.239896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.240695 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.242357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.243603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:31.244941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:31.245432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:31.245773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.246111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.246863 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:31.248185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.249088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:31.249823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.250651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:31.287560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:31.287983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:31.288263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.288487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.288936 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:31.290133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.290717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:31.291719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.292144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:31.292627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.292627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:31.295184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:31.295679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:31.295890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.296043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:31.296148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.296677 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.298407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:31.298896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:36.169487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:36.171082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:36.203135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.203568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.204451 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.205357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.205820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:36.238727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:36.240221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.240330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.240369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Traceback (most recent call last):
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.241087 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:36.242178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.243200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:36.245381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:36.245635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:36.245948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.246667 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:36.247457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.247797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:36.248408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.248729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.249072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:36.249072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.249072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:36.288167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:36.288648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:36.290703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.290967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.291619 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:36.292905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.293403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:36.294634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.295262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:36.295752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.295752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:36.295752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:36.296136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:36.296493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.296699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:36.296847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.297396 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.298638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:36.298965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:41.170073 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:41.171749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:41.173652 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=258 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:02:41.204436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.204700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.205358 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.206200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.207097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:41.239920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:41.241338 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.241611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.241737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.242645 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:41.245550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.246355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:41.247226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:41.247226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:41.247439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.247660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.248353 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:41.249724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.250670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:41.251329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.252156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.253047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:41.253047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.253047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:41.288884 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:41.289394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:41.290126 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.290554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Traceback (most recent call last):
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.291365 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:41.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.293332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-eee5bf9d-2862-46a7-b649-a9ad42a2973d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:41.294204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.294994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:41.295852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.295852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:41.296583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:41.296583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:41.297039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.297417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:41.297626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.298337 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:41.301121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:46.170697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:46.172551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:46.201620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.201778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.202206 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.202986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.203749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:46.240969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:46.241689 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.242144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.242442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.243220 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.244449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.244930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:46.247324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:46.247836 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:46.248298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.248512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Traceback (most recent call last):
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.249105 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:46.250542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.251549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5b4e4661-6ac1-401f-9ccb-5822fc1707fa None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:46.251948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.252676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.253442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:46.253442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.253442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:46.289595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:46.290201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:46.290931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.291373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.292310 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:46.293729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.294404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:46.295533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.296229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:46.297064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.297064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:46.297064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:46.297213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:46.297769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.298139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:46.298410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.299254 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.300976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:46.301445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:51.171356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:51.172533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:51.212173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.212401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.213147 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.215327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.216380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:51.241292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:51.242435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.242744 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.242995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.243746 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.245487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.246247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:51.247718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:51.248302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:51.248888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.249217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Traceback (most recent call last):
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.250391 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:51.251219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.251827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fb03e2e4-ffd2-4503-97ca-641fd338f032 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:51.252924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.253423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.253874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:51.253874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.253874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:51.290291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:51.290921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:51.291450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.291862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.292595 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:51.293511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.294040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:51.294569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.296336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:51.297023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.297023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:51.297103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:51.297807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:51.298239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.298601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:51.298854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.299742 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.301458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:51.302045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:56.172215 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:56.173561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:56.212235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.212406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.213005 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.213899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.214701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:56.242185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:56.243143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.243459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.243731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Traceback (most recent call last):
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.244577 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:56.246301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.247792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:56.248761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:56.249383 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:02:56.249720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.249994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.251790 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:56.252817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.253461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:02:56.254466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.255014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.255633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:56.255633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.255633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:56.291098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:56.291721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:56.292306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.292774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.293264 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:02:56.294965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.296329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:02:56.297755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.298606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.299483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:02:56.299679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.301311 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.302410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:02:56.302904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:01.173328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:01.174102 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:01.199047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.199399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.200160 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.201020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.201494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:01.243354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:01.243841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.244067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.244294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.245145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.246483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.247484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:01.248881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:01.249139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:01.249754 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.250035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.250680 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:01.251495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.252040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:01.252972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.253524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.254062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:01.254062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.254062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:01.291575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:01.292175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:01.292679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.292922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.293519 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:01.295020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.295678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:01.296990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.297693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:01.298402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.298402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:01.298402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:01.299293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:01.299523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.300118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:01.300118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.301101 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.303058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:01.303617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:06.173911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:06.174925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:06.207250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.207538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.208022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.209329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.210316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:06.243300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:06.244302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.244544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.244746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.245863 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.247143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.248008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:06.249202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:06.249492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:06.249826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.250901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.251510 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:06.252246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.253121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:06.254600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.255260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.255846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:06.255846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.255846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:06.292127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:06.292550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:06.293076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.293385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.294007 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:06.294987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.295671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:06.296046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.296727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:06.297534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.297534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:06.298780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:06.299452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:06.299721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.299953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:06.300092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:06.301860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:06.302489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:06.303008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:11.174458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:11.175982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:11.207894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.208040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.208537 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.210392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.210749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:11.243758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:11.244793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.245059 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.245301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.246073 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.247534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:11.249536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:11.250052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:11.250346 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.250607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Traceback (most recent call last):
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.250988 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:11.252207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.252864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-323d4c1e-36f4-4273-a109-7062d9859517 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:11.253601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.256642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.256976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:11.256976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.256976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:11.292811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:11.293320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:11.293987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.294434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.295627 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:11.296947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.297285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:11.300820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.301220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:11.301619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.301619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:11.301619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:11.301619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:11.302195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.302694 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:11.302932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.303858 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.304543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:11.305937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:16.175173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:16.176844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:16.273801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:16.276337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:16.277142 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:16.282640 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.283842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.283967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.285708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.285787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.287948 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.291309 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.292821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.293938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:16.296795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.297313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:16.299768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.300183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.300575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.300894 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:16.300894 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.300894 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.300950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.301300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:16.301615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.301615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.301952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:16.302226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:16.302429 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.302568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:16.302662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.303506 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:16.304375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Traceback (most recent call last):
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.304764 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:16.305550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.306184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-6089fea2-f30c-4755-b0f1-8fcc3eb2bd3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:16.306627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:16.306930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:16.307368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:16.307368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:21.175821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:21.177486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:21.222047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.222240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.222878 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.224057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.224475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:21.333457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:21.333457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:21.333457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:21.333693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:21.334393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:21.336069 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:21.336897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:21.337231 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.337454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.337574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.338094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.338252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.338649 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.340149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.340645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Traceback (most recent call last):
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.341124 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:21.341632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.342085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d3e8204c-2ada-4ee0-bdc6-95d175c98665 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:21.342869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.343295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.343856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:21.344046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.344222 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:21.345018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.345448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:21.346061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.346476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:21.346921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.346921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.348716 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.350020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:21.350533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:26.176775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:26.178237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:26.212319 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.212566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.213219 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.214167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.214741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:26.334242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:26.334535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:26.334535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:26.335414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:26.336837 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:26.337645 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:26.399188 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:26.401076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.402181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.402181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.402452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.402615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Traceback (most recent call last):
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.403128 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:26.404338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.404808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-a5c394b5-56b2-4f8f-847c-9c495294ec3b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:26.405396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.405877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fdfd94e2-edcc-4196-93ac-a5c0b27b49a1 None None] Traceback (most recent call last):
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.406460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-fdfd94e2-edcc-4196-93ac-a5c0b27b49a1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:26.406788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.407232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:26.407741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.407741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.407741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.407865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:26.407908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Traceback (most recent call last):
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.408437 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:26.410141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Traceback (most recent call last):
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.410614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d8c2920-c8b7-4229-8ade-701fc8996de8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:26.411834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.412312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:26.412771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.412771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-33c6ede7-751f-4f1d-ae91-15e1abc6823a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.415129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:26.415653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:31.177424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:31.178495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:31.219100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.219369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.220011 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.221390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.221923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:31.335059 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:31.336291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.336610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.336890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.337368 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:31.337561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:31.338218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:31.338735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.339610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:31.340940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:31.341998 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.341998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.342407 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:31.343255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.343854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:31.344923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.345433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.345894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:31.345894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.345894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:31.345894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.345894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.347460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.348041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:31.348512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.348985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:31.349607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.349607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:31.398914 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:31.399475 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:31.400043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.400587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:31.401201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Traceback (most recent call last):
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.459060 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-255e20b8-fb32-468d-8bae-cf87941516cf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.460742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:31.461157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:36.178112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:36.180060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:36.213511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.213956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.214882 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.215817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.216695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:36.335724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:36.337124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.337503 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.337753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.339528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:36.339528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:36.339528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.339842 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:36.342873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.343502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:36.344055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.344055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:36.344055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.344815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:36.345944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:36.346402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:36.347587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.348070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.348671 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:36.349346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.349761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:36.350413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.350887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:36.351455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.351455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:36.399943 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:36.400344 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:36.401252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.401647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:36.401882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.402923 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.404893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:36.405243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:41.179164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:41.180383 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:41.181743 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:03:41.212649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.213881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.214601 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.216157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.216836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:41.336742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:41.339587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:41.340487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.341351 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:41.342704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.343088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:41.343329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.344044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.344895 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:41.346392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.347065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:41.347803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.347803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.347803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.347803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.348348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:41.349132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.349781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:41.350227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.352207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:41.353109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.354030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:41.354801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.355535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.356356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:41.356356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.356356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:41.400597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:41.401018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:41.401507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.401804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:41.402053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.402698 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.403686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:41.404159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:46.179793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:46.181055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:46.214876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.215368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.216369 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.217841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.218884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:46.338711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:46.340396 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.341035 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.341294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.341625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:46.342917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:46.343509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.343710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.344662 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.345027 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:46.346086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.346742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.347539 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:46.349018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.349748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.350783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:46.350783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.350783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:46.350783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:46.352135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.352763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.353403 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:46.353840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.354549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:46.354948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.355678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:46.356956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.356956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:46.401669 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:46.402236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:46.402953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.403230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:46.403427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.403976 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.405190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:46.405715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:51.180488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:51.181566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:51.218608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.219063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.219902 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.220994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.221557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:51.339362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:51.340862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.340862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.341496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.342381 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:51.344449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.344827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:51.345166 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:51.345166 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:51.345721 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.345803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.346391 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:51.348238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:51.349039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:51.350101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.350816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.351729 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:51.352351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:51.353084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.353959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.354899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:51.402327 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:51.403387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:51.404239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.404592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:51.404788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.405689 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.408780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:51.409259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:56.180966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:56.182063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:56.221159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.221593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.222741 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.223961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.224497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:56.339928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:56.341985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.342259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.342438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.343169 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:56.344423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.345138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:56.345945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:56.345945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:03:56.345945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.346132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.346546 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:56.348401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.349112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:03:56.351145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.351895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.352638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:56.352638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.352638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:56.352638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:56.352638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:56.353285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.353457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:03:56.355175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.355596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:03:56.356002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.356427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:56.356898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.356898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:03:56.402961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:03:56.403474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:03:56.404008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.404213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:03:56.404357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.404881 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.405718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:03:56.406446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:01.181638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:01.182950 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:01.218347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.218899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.219988 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.221195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.222436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:01.341479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:01.342552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.342892 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.343148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.343973 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:01.344931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.345430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:01.345982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:01.346603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:01.347279 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.347764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.351650 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:01.352217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:01.352863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:01.354298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.355445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.356240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.356921 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:01.357632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.358189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:01.358721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.359252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:01.359819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.359819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:01.403719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:01.404437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:01.405132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.405513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:01.405684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.406637 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.408959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:01.410015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:06.182749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:06.183435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:06.220517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.220936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.222004 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.223742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.224149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:06.342308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:06.343385 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.343629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.343802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Traceback (most recent call last):
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.344525 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-c74d4b24-cd44-4366-8b25-3f9bb339fc78 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:06.346141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.346516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:06.346861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:06.346990 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:06.347316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.347512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.348018 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:06.348841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.349179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:06.350023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.350363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.350695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:06.350695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.350695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:06.353737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:06.354176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:06.354481 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.354645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.355000 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:06.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.356032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:06.356526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.356831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:06.357164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.357164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:06.404603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:06.405465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:06.406309 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.406594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:06.406925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.408767 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.409651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:06.410578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:11.182813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:11.183810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:11.213630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.214059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.215691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.217227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.217939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:11.342921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:11.344837 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.345240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.345511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.346889 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:11.348021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.348542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:11.349124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:11.349124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:11.349124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.349383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Traceback (most recent call last):
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.349939 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:11.350830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.351549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-ae92a93c-4a4c-4738-a891-12571bce6e90 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:11.352256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.352830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.353516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:11.353516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.353516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:11.354259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:11.354679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:11.355301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.355750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.356507 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:11.357606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.358124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:11.359371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.359838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:11.360448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.360448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:11.405452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:11.406015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:11.406585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.406876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:11.407052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.407704 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.408925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:11.409415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:16.183308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:16.184365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:16.209988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.210232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.210834 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.211984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.212950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:16.343870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:16.346283 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.346517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.346681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.347644 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:16.349070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.350051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:16.350946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:16.350946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:16.350946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.351075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.351638 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:16.352461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.352952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:16.353475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.353967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.354584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:16.354584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.354584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:16.354695 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:16.355138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:16.355499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.355727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Traceback (most recent call last):
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.356253 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:16.357793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.358091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:16.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.360202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:16.360603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.360603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:16.406226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:16.406691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:16.407067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.407408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:16.408006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.408153 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.409243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:16.409842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:21.184600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:21.185849 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:21.225645 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.225860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.226623 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.227896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.228538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:21.344561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:21.345889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.346184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.346412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.347447 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:21.350570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.352013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:21.352969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:21.352969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:21.352969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.352969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.353856 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:21.355732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:21.356076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:21.356294 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:21.357439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.358076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:21.358076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.358076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:21.358076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.358076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Traceback (most recent call last):
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.358592 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:21.359788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.360077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-24778817-b426-402b-9a62-037e0903f1dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:21.360568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.361011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:21.361360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.361360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:21.406756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:21.407220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:21.407593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.407813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:21.407951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.408528 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.409289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:21.409795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:26.185441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:26.188479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:26.226036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.226202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.226923 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.227789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.228912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:26.345350 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:26.346819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.347114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.347395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:26.350028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:26.350599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.351107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:26.351498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:26.351899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:26.352330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.352592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.353281 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:26.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.355061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:26.356148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.356626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.357122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:26.357122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.357122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:26.357122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:26.357122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:26.357755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.358070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.358720 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:26.359691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.360182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:26.360783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.361874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:26.362387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.362387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:26.407926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:26.408484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:26.409094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.409409 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:26.409569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.410241 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.411876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:26.412923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:31.185938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:31.187065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:31.220331 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.220549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.221300 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.222477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.223390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:31.346079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:31.346932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.347101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.347245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.347750 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:31.348772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.349087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:31.351821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:31.352293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:31.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.352884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.355890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.356662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:31.357106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.357621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.358146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:31.358146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.358146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:31.358146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:31.358146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:31.358505 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.358781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.359328 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:31.360050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.360552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:31.361128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.361637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:31.362258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.362258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:31.408582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:31.409287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:31.410051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.410544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:31.410842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.412144 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.414177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:31.415404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:36.186570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:36.188081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:36.221002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.222034 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.223091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.223921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:36.346761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:36.347751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.347848 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.348504 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:36.349714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.350076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:36.352463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:36.352948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:36.353760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.353760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.353940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:36.354895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.355209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:36.356037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.356371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.356716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:36.356716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.356716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:36.358247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:36.358625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:36.359379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.359379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.359602 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:36.360594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:36.361890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.362405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:36.362957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.362957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:36.409580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:36.410363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:36.411236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.411710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:36.411985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.413613 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.416103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:36.416922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:41.187228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:41.188513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:41.190389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:04:41.227753 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.228070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.229123 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.229940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.230370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:41.347499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:41.348697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.349165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.349165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.350332 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:41.352114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.352649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:41.353152 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:41.353572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:41.354047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.354348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.355117 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:41.356779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.357207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:41.358697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.359174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.359684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:41.359684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.359684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:41.359684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:41.359684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:41.360062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.360374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.361058 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:41.362476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.362882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:41.364075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.364540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:41.364985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.364985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:41.410303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:41.411070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:41.411675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.412095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:41.412354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.413192 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.414687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:41.415668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:46.188003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:46.189185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:46.220184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.220502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.221145 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.222020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.222633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:46.348145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:46.349487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.349487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.349487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.350125 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:46.351355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.352206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:46.353209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:46.353488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:46.353827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.354043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.354559 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:46.355292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.355985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:46.356492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.357184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.358036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:46.358036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.358036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:46.359548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:46.359991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:46.360391 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.360619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.361116 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:46.362040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.362515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:46.363410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.364025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:46.364616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.364616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:46.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:46.411931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:46.412844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.412844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:46.412953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.413542 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.414491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:46.414998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:51.188313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:51.189354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:51.220136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.220362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.220782 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.221973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.222845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:51.348647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:51.349977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.350256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.350514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.351479 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:51.353441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.354090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:51.354809 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:51.354809 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:51.355911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.356118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.356745 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:51.357448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.358012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:51.358598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.359117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.359669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:51.359669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.359669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:51.359961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:51.360502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:51.360941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.361110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.361600 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:51.362797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.363260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:51.364013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.364526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:51.365015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.365015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:51.412104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:51.412919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:51.413364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.413610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:51.413767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.414671 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.416619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:51.417245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:56.189097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:56.190071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:56.223172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.223326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.223866 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.224891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.225527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:56.349100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:56.350614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.350861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.351068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.351869 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:56.353542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.354074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:56.354638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:56.354692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:04:56.355117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.355407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.356069 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:56.359608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:56.360954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.361568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:56.362305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.363950 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:04:56.364390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.364925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:04:56.366085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.366769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:56.367514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.367514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:04:56.412571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:04:56.413070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:04:56.413880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.414506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:04:56.414804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.415627 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.416798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:04:56.417313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:01.189599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:01.191136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:01.225015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.225207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.225803 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.226852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.227380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:01.349874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:01.351238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.351470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.351567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.352388 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:01.354543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.355035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:01.355597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:01.355597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:01.355597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.355597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.355731 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:01.356239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.356681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:01.356947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.357382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.357900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:01.357900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.357900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:01.360680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:01.360829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:01.361023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.361178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.361498 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:01.361981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.362423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:01.362675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.363097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:01.363624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.363624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:01.413163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:01.413744 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:01.414248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.415445 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:01.415907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.417446 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.419514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:01.420080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:06.190547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:06.192167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:06.227286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.227731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.228721 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.229948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.230542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:06.350606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:06.351904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.352292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.352639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.353609 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:06.355958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.356459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:06.356915 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:06.356915 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:06.357657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.357958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.358791 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:06.359870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.360321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:06.361038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.361497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.361987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:06.361987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.361987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:06.361987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:06.361987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:06.362466 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.363617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.364723 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:06.366132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.367615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:06.369665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.370576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:06.371426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.371426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:06.413759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:06.414202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:06.414567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.414817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:06.414976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.415501 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.416549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:06.417030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:11.191237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:11.192115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:11.230995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.231253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.232405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.232899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.233449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:11.351718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:11.353538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.353779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.354168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.355242 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:11.356655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.357398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:11.357893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:11.357893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:11.357893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.358014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.358635 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:11.359544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:11.360496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.360895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.361401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:11.361849 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:11.362097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:11.362560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.362851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.363322 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:11.363928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.364432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:11.364904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.365384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:11.365948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.365948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:11.414377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:11.415096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:11.415400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.415599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:11.415714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.416312 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.418482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:11.418947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:16.191568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:16.192644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:16.227548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.227716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.228482 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.230675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.231528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:16.352978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:16.353658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.353909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.354257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.355166 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:16.357254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.357778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:16.358306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:16.358306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:16.358814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.359025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.359712 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:16.360922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.361371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:16.363173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.363705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.364232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:16.364232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.364232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:16.364232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:16.364232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:16.364441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.364842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.365648 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:16.366740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.367170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:16.368874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.369348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:16.369814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.369814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:16.415535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:16.416055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:16.416401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.416603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:16.416712 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Traceback (most recent call last):
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.417348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-2b4a3048-cff2-4afd-9630-570d0fb449f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.418060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:16.418508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:21.192324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:21.194032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:21.229798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.229798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.229975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.231058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.231512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:21.355681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:21.356787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.357888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.357888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.358591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:21.358953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.359372 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:21.360553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.362704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:21.363392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.364016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.364898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:21.365489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:21.366071 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.366447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.366961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:21.367322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.367806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:21.368560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.368560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:21.416079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:21.416694 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:21.417426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.417847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:21.418131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.419039 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.420928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:21.421878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:26.192716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:26.194209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:26.239495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.239819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.240565 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.241573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.242194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:26.356619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:26.357759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.358167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.358442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.359384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.359880 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:26.360542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:26.361024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:26.363119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.363691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.364356 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:26.364755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:26.366687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:26.367385 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:26.368407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.369149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.370016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:26.370016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.370016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:26.370016 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.370016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.370238 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:26.371289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.371805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:26.372929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.374045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:26.374943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.374943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:26.416806 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:26.417614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:26.418478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.418801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:26.419026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.419674 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.420813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:26.421669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:31.193221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:31.194456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:31.233843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.234326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.236073 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.237504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.238034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:31.357492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:31.358643 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.359057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.359330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.360149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:31.360716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:31.362412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.362807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:31.363147 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:31.363396 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.363530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.364042 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:31.364930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.365602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:31.367087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.367758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.368397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.368665 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:31.369441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.369847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:31.370473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.371005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:31.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:31.417576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:31.418047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:31.418654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.419047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:31.419236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.419956 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.421049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:31.421883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:36.193979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:36.195545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:36.234782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.234782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.235562 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.236634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.237753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:36.358038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:36.359377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.359615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.359750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.360656 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:36.362835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.363647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.364554 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:36.365557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.366106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:36.366520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.366939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.367430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:36.367430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.367430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:36.367570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:36.367881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:36.368205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.368525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.369089 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:36.369939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.370374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:36.370969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.371606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:36.372155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.372155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:36.418254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:36.418834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:36.419414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.419819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:36.420054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.420901 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.422660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:36.423182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:40.841068 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:40.851247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:05:40.851482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:05:40.851556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:40.887730 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.888104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.888365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.888472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.889036 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.890225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.890839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.891419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:40.891419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.891419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:40.891419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:40.919014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.919386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.919988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.920291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.921047 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.921989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.922561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.923222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:40.923222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.923222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:40.923222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:40.954516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.954706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.954921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.954999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.955443 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.956353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.956954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.957762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:40.957762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.957762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:40.957762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:40.986657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.987342 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.987342 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:40.987342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.987974 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.988844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:40.989643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:40.990486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:40.990486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:40.990486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:40.990486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:41.064813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.065123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.065457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.065797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.065797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.066608 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.066940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:05:41.068005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:41.068405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:41.068792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:05:41.173048 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.173337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.174026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.174301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.175077 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:41.228728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.230426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.231448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:05:41.231448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.231448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:05:41.231448 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Maintenance task: Synchronization completed (took 0.32 seconds)
Apr 02 06:05:41.231448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:41.232977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:41.234375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=434 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:05:41.271306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.271581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.272200 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.273072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.273850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:41.358603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:41.359436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.359657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.359854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.361286 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:41.362179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.362820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:41.365166 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:41.365166 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:41.365166 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.365166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.365742 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:41.368135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.368790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:41.370411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.371995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.372797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:41.372797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.372797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:41.372797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:41.372797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:41.373016 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.373197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.373914 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:41.374522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.374866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:41.375277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.375832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:41.376389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.376389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:41.420062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:41.420502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:41.421110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.421438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:41.421530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.423225 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.424179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:41.425492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:46.231797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:46.232801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:46.323824 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.324094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.324809 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.325700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.326084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:46.359326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:46.360124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.360289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.360442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.361219 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:46.362113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.362559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:46.365897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:46.365897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:46.365897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.365897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.368326 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:46.368918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.369286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:46.369798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.370119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.370559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:46.370559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.370559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:46.371550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:46.371864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:46.372328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.372389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.372820 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:46.373565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.373984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:46.374594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.374966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:46.375327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.375327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:46.420732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:46.421165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:46.421666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.421863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:46.422106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.422922 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.424916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:46.425774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:51.232701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:51.234571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:51.269674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.270004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.270803 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.271988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.272866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:51.359633 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:51.361012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.361012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.361418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.362443 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:51.363259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.363798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:51.364353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:51.364635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:51.364954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.365146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.365656 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:51.366458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.366796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:51.367409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.367722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.368121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:51.368121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.368121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:51.371931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:51.372476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:51.372974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.373327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.374390 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:51.375375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.375810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:51.377046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.378060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:51.379050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.379050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:51.421520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:51.422871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:51.423762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.424447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:51.424748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.426177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.427447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:51.427861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:56.233891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:56.235418 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:56.269029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.269442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.270321 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.271178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.272016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:56.421432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:56.421432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:56.421691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:56.422467 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:05:56.423354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.423741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.424121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.425165 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:56.427627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.428117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:56.428726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:56.429218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:05:56.430015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.430380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.431550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.431787 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:56.432210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:56.433445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:56.434664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:05:56.435211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.436053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:56.437014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.438107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:56.438930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.439768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.440789 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.443400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:05:56.443761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:01.234560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:01.235808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:01.267599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.268002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:01.272327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:01.273291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.274236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:01.422240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:01.422607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:01.423522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:01.424223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.424504 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.424674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.425473 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.426943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.427844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:01.428780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:01.428780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.428780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:01.428780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.429355 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:01.429875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:01.431750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:01.432678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.433393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:01.435287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.435831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:01.436377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:01.436942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:01.437491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:01.438871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.439360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:01.439853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.439853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:01.439853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:01.439853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.439966 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.441113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:01.441690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:06.235191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:06.237251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:06.274699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.275089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.276171 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.277215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.278637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:06.422919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:06.423150 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:06.424437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:06.425465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.425799 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.426042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.426953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.427250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.428018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.428306 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:06.429898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:06.430715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:06.431890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.432698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:06.433360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:06.435374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.435842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:06.436419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.436419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:06.436500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.437527 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:06.438538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:06.439033 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:06.440182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.440681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:06.441259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.441259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:06.441259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:06.441259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.441470 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.442645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:06.443209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:11.235732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:11.236789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:11.273858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.274162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.274731 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.275493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.275846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:11.423799 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:11.424690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:11.425044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:11.425891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.426323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.426593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.427595 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.429198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.430199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.430986 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:11.432655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:11.433484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:11.434764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.435457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.436302 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:11.437768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.438234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:11.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:11.442359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.442985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:11.443637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Traceback (most recent call last):
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.444194 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-9d24f9e5-ce8c-43cc-8e2c-09a35d9adb59 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.445216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:11.445819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:16.236183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:16.237414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:16.274254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.275909 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.276378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.276909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:16.424389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:16.425594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:16.426070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:16.426822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.427242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.427493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.428598 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.430758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.431515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:16.432032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.432032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.432032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.432147 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:16.432830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.433349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:16.433752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.434665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.435252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.435696 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:16.436765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.437431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:16.438007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.438506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:16.439021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.439021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:16.440952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:16.441529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:16.441935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.442187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:16.442439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.443036 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.444234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:16.444857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:21.236812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:21.238575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:21.275253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.275564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.276293 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.277535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.278673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:21.425127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:21.426047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:21.426558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.426796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.426952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.427773 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:21.428426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.430497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.431452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.432382 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:21.433439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:21.434251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:21.435897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.436415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.437021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.437720 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:21.438518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.439001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:21.439656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.440202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:21.440848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.440848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:21.441337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:21.441729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:21.442263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.442838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:21.443203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.444134 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.445802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:21.446876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:26.237825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:26.239521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:26.275711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.276066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.276938 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.278220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.278783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:26.425832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:26.427226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.427484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.427762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.428252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.428884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.431112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.432119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.432940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:26.435233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.436018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:26.437381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.437926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.438468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:26.438468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.438468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:26.438468 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:26.438468 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:26.439529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.439808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.440359 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:26.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:26.442696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.443363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:26.443865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.443865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:26.443865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:26.443865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:26.443865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.444036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:26.444114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.444684 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.445713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:26.446234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:31.238374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:31.239984 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:31.273664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.274116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.275059 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.276123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.276972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:31.426545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:31.428431 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.428777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.429351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.430463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.432439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.433424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:31.434320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:31.434320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:31.434509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.436106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.436925 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:31.438430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:31.438885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:31.440291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.440807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:31.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:31.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:31.441364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.441792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.442663 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:31.444224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:31.453208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.453588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:31.454393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:31.455068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:31.455670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:31.456605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:36.239970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:36.241536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:36.275427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.275657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.276202 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.277103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.278082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:36.427167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:36.428614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.428968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.429283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.430313 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:36.431909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.433129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:36.434700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:36.434700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:36.434700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.434700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.436181 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:36.437533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.438235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:36.438761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.439484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:36.439818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:36.440235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:36.440559 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.440747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.441483 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:36.443220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.443671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:36.445567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.445973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:36.446364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.446364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:36.446364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:36.446539 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:36.446868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.447136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:36.447217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.447749 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.449144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:36.449592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:41.241130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:41.242379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:41.244074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:06:41.276034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.276576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.277705 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.278889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.279982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:41.427762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:41.428874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.429093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.429254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.430064 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:41.432007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.432487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:41.434044 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:41.434441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:41.434856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.435116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.435565 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:41.436355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.436758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:41.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.437737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.438139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:41.438139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.438139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:41.440170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:41.440611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:41.441014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.441231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.441797 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:41.443595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.444147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:41.445589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.447100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.447747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:41.448072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.448501 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.449852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:41.450460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:46.241506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:46.243519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:46.281778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.282000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.282618 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.283535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.283906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:46.428297 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:46.429307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.429581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.429791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.430664 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:46.432336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.432811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:46.434551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:46.435022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:46.435452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.435692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.436443 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:46.437486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.438355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:46.439134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.439860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.440702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:46.440702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.440702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:46.440702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:46.442063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:46.442518 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.442783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.443418 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:46.444795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:46.447769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.448238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:46.448812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.448812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:46.448812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:46.449170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:46.450912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.451347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:46.451502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.452431 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.453759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:46.454417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:51.242621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:51.244250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:51.283328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.283589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.284305 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.285189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.285556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:51.428805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:51.430042 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.430232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.430372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.430940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:51.432250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.433040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:51.435046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:51.435749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:51.436084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.436464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.437151 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:51.437835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.438368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:51.438788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.439215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.439765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:51.439765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.439765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:51.442014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:51.442431 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:51.443510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.443911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.444628 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:51.445278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.445710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:51.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.446463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:51.446963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.446963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:51.449183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:51.449670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:51.450063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.450249 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:51.450383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.450821 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.451684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:51.452196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:56.243687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:56.245005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:56.272824 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.273030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.273615 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.274503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.275496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:56.429604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:56.430851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.431022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.431139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.432135 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:56.434383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.436214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.437420 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:56.438181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.439554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:56.440677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.441381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:56.442571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:56.442932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:56.443284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.443591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.444013 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:06:56.444695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.445309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:06:56.445824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.446489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:56.447119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.447119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:06:56.449525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:06:56.450227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:06:56.450553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.450763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:06:56.450911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.451406 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.452325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:06:56.452769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:01.244219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:01.246283 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:01.279840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.280395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.281420 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.282428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.282895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:01.430036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:01.431238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.431521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.431698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.432787 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:01.435072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.435440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:01.436348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:01.436720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:01.437052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.437281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.437745 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:01.438862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.439314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:01.440754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.441672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:01.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:01.443051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:01.443407 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:01.443776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.444187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.444978 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:01.446017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.446716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:01.447431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.447966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:01.448463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.448463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:01.450056 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:01.450548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:01.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:01.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.451718 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.452854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:01.453379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:06.244973 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:06.247100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:06.287182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.287607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.289823 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.291027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.291674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:06.430775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:06.432027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.432356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.432595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.433524 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:06.435084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.435932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:06.437423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:06.437423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:06.438047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.438047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.438614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:06.439983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.440943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:06.441633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.442430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.443359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:06.443359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.443359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:06.443613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:06.443986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:06.444438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.444798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.445578 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:06.446829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.447429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:06.448615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.449118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:06.449643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.449643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:06.450506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:06.451304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:06.451784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.452077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:06.452215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.452749 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.454556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:06.455083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:11.245831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:11.247332 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:11.282694 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.283108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.283988 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.284892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.285945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:11.431411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:11.432187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.432473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.432473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.433250 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:11.435303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:11.437354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:11.437856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:11.438232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.438405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.438975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:11.440407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.441726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:11.442201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.443197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:11.446169 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.446965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.447558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.448210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.448909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:11.450937 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:11.451388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:11.451765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.452169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:11.452359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.452861 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.454646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:11.455147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:16.246463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:16.248050 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:16.277506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.277941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.279194 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.280469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.281437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:16.431963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:16.433132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.433381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.433504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.434110 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:16.435504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.436065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:16.437735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:16.438579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:16.439120 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.439449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.440574 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:16.442069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.442923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:16.443558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.444200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.444913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:16.444913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.444913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:16.444913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:16.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:16.446801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.447317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.448202 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:16.449781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.450206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:16.451717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.452388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:16.453076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.453732 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.455542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:16.456260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:21.247077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:21.248816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:21.283257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.283410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.284099 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.285174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.286347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:21.432845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:21.434110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.434485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.434757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.435698 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:21.437728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.438411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:21.438893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:21.438893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:21.439309 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.439648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.440447 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:21.441725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.442440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:21.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.444127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.444774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:21.444774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.444774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:21.445161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:21.445608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:21.445997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.446381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.447048 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:21.448494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.448875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:21.450672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.451183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:21.451558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.451558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:21.452447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:21.452802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:21.453223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.453578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:21.453790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.454439 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.456230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:21.456642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:26.248034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:26.249529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:26.285770 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.286202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.287127 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.288429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.289776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:26.433344 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:26.434363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.434591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.434747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.435431 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:26.436645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.438161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:26.438972 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:26.439119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:26.439647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.439852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.440487 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:26.441946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.442755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:26.443580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.444087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.444648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:26.444648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.444648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:26.445497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:26.445793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:26.446087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.446338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.446968 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:26.447625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.448389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:26.449166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.450043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:26.451028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.451028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:26.452899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:26.453217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:26.453612 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.453940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:26.454155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.454810 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.456420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:26.457017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:31.248555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:31.249713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:31.284654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.285134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.286317 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.287435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.288222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:31.434026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:31.435448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.435448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.435921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.436560 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:31.438128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.438620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:31.439118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:31.439511 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:31.439816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.440047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.440723 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:31.441807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.442529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:31.443186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.443694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.444199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:31.444199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.444199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:31.445994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:31.446418 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:31.447067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.447398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.448165 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:31.449612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.450312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:31.451924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:31.453875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.453875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:31.453875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:31.454489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:31.454658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.454980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:31.455202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.455663 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.456678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:31.457127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:36.249369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:36.251328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:36.288713 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.288964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.289956 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.291178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.292181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:36.434672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:36.435733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.436165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.436604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.437610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:36.439655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.440177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:36.440863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:36.440863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:36.440863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.441105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.441734 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:36.442545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.443071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:36.443582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.444165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.444844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:36.444844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.444844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:36.446506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:36.447165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:36.447751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.448092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:36.450441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.450936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:36.452221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.452986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:36.453582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.453582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:36.453848 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:36.454374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:36.454689 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.454965 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:36.455132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.455686 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.458287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:36.459041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:41.250156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:41.251742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:41.253550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:07:41.288601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.288892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.289598 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.290858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.291848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:41.435438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:41.437056 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.437400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.437640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.438659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:41.440390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.441684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.443133 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:41.444706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.445473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:41.446488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.447030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.447565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:41.447565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.447565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:41.447565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:41.447565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:41.447994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.448405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.449140 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:41.450542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.450983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:41.452308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.452852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:41.453477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.453477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:41.454305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:41.454868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:41.455361 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.455715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:41.455989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.456713 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.457961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:41.458705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:46.272436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:46.273158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:46.301680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.302100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.302984 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.303878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.304368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:46.436064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:46.437362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.437735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.438046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.439029 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:46.440255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.440739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:46.441241 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:46.441816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:46.442390 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.442687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.443472 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:46.444882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.445814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:46.446606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.447617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.448733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.449174 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:46.450586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.450966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:46.452459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.453051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:46.453591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.453591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:46.454839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:46.455588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:46.456002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.456233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:46.456467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.457131 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.458447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:46.458921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:51.272997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:51.275370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:51.348465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.348864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.349672 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.350487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.350993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:51.436865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:51.438076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.438458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.438708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.439610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:51.441626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.442078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:51.442931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:51.443135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:51.443813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.444136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.445333 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:51.446620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.447118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:51.448470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.448937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.449508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:51.449508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.449508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:51.449508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:51.449508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:51.449687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.449925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.450620 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:51.451394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.451801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:51.452491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.452921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:51.453454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.453454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:51.455363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:51.455779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:51.456319 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.456614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:51.456824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.457636 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.458870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:51.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:56.273916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:56.275342 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:56.306105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.306586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.307454 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.308388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.309163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:56.437531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:56.438887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.439216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.439491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.440370 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.442079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.442876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:56.443665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:56.443665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:07:56.444321 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.444622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.445426 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:56.446959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.447440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:07:56.448433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.448868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.449346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:56.449346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.449346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:56.449346 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:56.449458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:56.449766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.449947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.450399 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:07:56.451201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.451647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:07:56.452483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.452894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:56.453433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.453433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:07:56.455894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:07:56.456286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:07:56.456489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.456673 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:07:56.456828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.457286 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.458199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:07:56.458676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:01.274762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:01.275976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:01.309587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.309899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.310768 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.311724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.312572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:01.438211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:01.443791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:01.444460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.444787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.445036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.446114 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.448066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.449373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:01.450024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:01.450024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.450024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.450169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:01.451177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.451683 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:01.452792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:01.453614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:01.454827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.455427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.455899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:01.455899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.455899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:01.455899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.456006 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:01.457678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:01.458173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:01.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.460594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:01.461322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.461322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:01.461322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:01.461322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.461516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:01.461839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.462583 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.464431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:01.465099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:06.275074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:06.276650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:06.314228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.314678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.315610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.316648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.317476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:06.443460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:06.444875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.445209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.445489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.446468 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:06.448417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.448932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:06.449495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:06.449495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:06.449621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.449905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.450695 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:06.452415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:06.453374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:06.455176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.456151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.457009 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:06.457834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.458322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:06.458829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.459473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:06.460123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.460123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:06.460295 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:06.460576 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:06.461155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.461748 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:06.461748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.462758 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.463836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:06.464461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:11.275871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:11.277534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:11.321926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.322872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.323419 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.324551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.326684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:11.444095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:11.445363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.445698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.445932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.446807 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:11.448740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.449903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:11.450798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:11.450798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:11.450798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.450798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.451295 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:11.452575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.453168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:11.454178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.454684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:11.455222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.455740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.456546 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:11.457532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.457959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:11.459384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.459835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:11.460333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.460333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:11.461025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:11.461516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:11.461938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.462227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:11.462479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.463133 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.465490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:11.465996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:16.276497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:16.278184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:16.309562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.310055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.310960 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.311837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.312653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:16.444729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:16.446054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.446427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.446710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.447709 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:16.449586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.450369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:16.451211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:16.451211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:16.451211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.451211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.451823 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:16.452993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.453832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:16.454566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.455426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:16.456027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.456225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:16.458395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.458834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:16.459421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.459874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:16.460375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.460375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:16.461690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:16.462070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:16.462330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.462550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:16.462684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.463135 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.464095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:16.464589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:21.277198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:21.278925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:21.314029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.314226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.314748 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.315658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.316089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:21.445566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:21.446736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.447096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.447447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.448387 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:21.450005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.450757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:21.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:21.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:21.451498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.451706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.452434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:21.453774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.454249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:21.456204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.457150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.458076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.458767 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:21.459544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.460676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:21.461139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.462083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:21.463149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.463661 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.464960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:21.465551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:26.278123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:26.279527 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:26.316145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.316145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.316753 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.317983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.319216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:26.446394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:26.448905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.449339 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.449549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.450325 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:26.451799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.452371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:26.452919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:26.452919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:26.453370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.453629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.454251 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:26.455241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.455902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:26.456261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.456789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.457327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:26.457327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.457327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:26.457327 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:26.457502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:26.457898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.458115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.458640 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:26.459924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.460397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:26.461651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.462143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:26.462661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.462661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:26.462661 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:26.462968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:26.463328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.463498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:26.463634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.464240 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.466722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:26.467211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:31.278798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:31.280425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:31.311142 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.311402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.312251 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.313449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.314849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:31.447496 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:31.448851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.449230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.449606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.450755 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:31.452569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.453439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:31.454438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:31.454438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:31.454438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.454438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.454779 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:31.456099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.457045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:31.457621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.458624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.459666 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:31.460455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.461062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:31.461481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.461961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:31.462534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.462534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:31.462946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:31.463452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:31.463627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.463889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:31.464028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.464650 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.465648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:31.466528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:36.279589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:36.281013 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:36.313215 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.313646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.314649 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.315842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.316632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:36.448128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:36.449823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.450281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.450594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.451675 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:36.453643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.454512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:36.455322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:36.455322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:36.455322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.455322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.455660 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:36.457639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.458110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:36.458877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.459321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.459930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:36.459930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.459930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:36.459930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:36.459930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:36.460194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.460520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.461087 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:36.462480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.462913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:36.464230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.464699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:36.465215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.465215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:36.465215 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:36.465215 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:36.465453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.465667 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:36.465811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.466550 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.468495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:36.469003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:41.280105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:41.281008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:41.282544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:08:41.316443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.316805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.317666 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.318928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.320046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:41.448954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:41.450055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.450298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.450543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.451303 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:41.452788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.453743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:41.454695 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:41.455415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:41.455415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.455779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.456172 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:41.457567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.458636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:41.459179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.460037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:41.460648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.460892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.461374 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:41.462675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.463140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:41.464896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.465493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:41.466019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.466019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:41.466019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:41.466019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:41.466208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.466419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:41.466569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.467091 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.468121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:41.468734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:46.280731 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:46.282379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:46.314817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.315055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.315561 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.316621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.317083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:46.449709 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:46.450806 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.451071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.451318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.452561 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:46.454312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.455243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:46.456455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:46.456455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:46.456455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.456455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.457079 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:46.458593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.459062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:46.462105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.462654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.463105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:46.463105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.463105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:46.463105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:46.463105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:46.464353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.464353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.464815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:46.466430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.467159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:46.467872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.468638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.469627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:46.469817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.470468 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.471539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:46.472068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:51.281369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:51.283000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:51.320285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.320716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.321568 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.322524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.323656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:51.450421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:51.451223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.451442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.451563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.452197 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:51.453324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.454132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:51.455312 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:51.455523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:51.455725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.455842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.456185 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:51.456790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.458069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:51.459024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.459837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:51.462806 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:51.462938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:51.463541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.463825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.464392 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:51.465108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.465936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:51.466485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.467415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:51.468328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.468328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:51.468640 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:51.469042 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:51.469577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.470022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:51.470315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.471177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.472619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:51.473300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:56.282133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:56.283687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:56.317474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.317780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.318247 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.319288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.320147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:56.451050 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:56.452359 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.452732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.453028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.454022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:56.455944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.457100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.458067 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:56.458785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.459770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:08:56.460169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.461475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.462042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:56.462042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.462042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:56.463074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:56.463332 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:56.464005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.464005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.464594 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:08:56.465831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.466330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:08:56.467667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.468109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:56.468641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.468641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:08:56.468984 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:08:56.469393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:08:56.469635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.469863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:08:56.470002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.470618 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.471605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:08:56.472045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:01.282779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:01.283734 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:01.317567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.317781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.318318 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.319544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.320414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:01.451736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:01.452690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.452931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.453127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.454107 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:01.456040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.456960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:01.457779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:01.457779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:01.457779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.457779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.458233 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:01.459692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.460559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:01.461706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.462557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.463620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:01.463620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.463620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:01.463620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:01.464141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:01.464654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.464926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.465545 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:01.466863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.467414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:01.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.469432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:01.470109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.470109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:01.470109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:01.470109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:01.470263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.470507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:01.470767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.471319 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:01.472815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:06.283455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:06.285009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:06.322580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.322795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.323614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.324593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.325897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:06.452309 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:06.453907 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.454217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.454349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.455105 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:06.456878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.458011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.458982 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:06.459935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:06.461512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.462401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.463507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:06.463507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.463507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:06.464038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:06.464432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:06.465485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.466053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.466790 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:06.467625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.468089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:06.468838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.469341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:06.470053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.470053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:06.470053 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:06.470288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:06.470752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.471015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:06.471167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.471726 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.472852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:06.473452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:11.284060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:11.285002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:11.316690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.316999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.317795 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.319055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.319975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:11.453156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:11.454638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.454826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.455045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.456011 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:11.458260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.459085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:11.459939 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:11.459939 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:11.459939 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.459939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.460222 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:11.460952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.461636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:11.462198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.462770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.463402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:11.463402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.463402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:11.464566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:11.464963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:11.465372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.465588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.466089 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:11.467563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.468087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:11.469640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:11.470665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.470665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:11.470665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:11.470665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:11.470916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:11.471419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.471892 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.472963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:11.473515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:16.284558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:16.285963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:16.455692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:16.459068 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:16.460416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.462204 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:16.462691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.463068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.464748 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.464994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.465627 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:16.468457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.469130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:16.471689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.472236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:16.472755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:16.476370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.476921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:16.477697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:16.479147 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:16.480377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:16.481001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.481417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.482715 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:16.483635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.484151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:16.484988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.485515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:16.485970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.485970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:16.485970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.485970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.485970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.486853 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.490004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.490818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:16.503896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:16.504253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.504965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.505784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:16.506680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:21.285308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:21.287854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:21.320262 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.320692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.321651 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.322534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.323598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:21.456800 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:21.458059 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.458471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.458730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.459852 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:21.462652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.463011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:21.463516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:21.463516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:21.464161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.464518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.465235 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:21.466572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.467076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:21.468352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.468691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.469058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:21.469058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.469058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:21.473154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:21.473483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:21.474034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.474381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.475133 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:21.476736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.477825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:21.479360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.480375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:21.481459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.482708 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.484592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:21.485308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:26.286504 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:26.288306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:26.317563 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.318058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.318924 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.321005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.321714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:26.457441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:26.458456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.458692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.458869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.459568 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:26.460822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.461609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:26.463353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:26.463986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:26.464513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.464833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.465437 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:26.466834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.467685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:26.468518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.469545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:26.469545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.469545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:26.473524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:26.474025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:26.475138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.475605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.476854 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:26.478256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.478700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:26.480131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.480621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:26.481201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.481201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:26.481201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:26.481201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:26.481392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.481647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:26.481814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.482537 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.483679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:26.484163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:31.287074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:31.288304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:31.323964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.324400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.325298 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.326179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.327654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:31.458139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:31.459470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.459697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.459957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.461105 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:31.462346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.463130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:31.464310 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:31.464544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:31.465304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.465795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.466887 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:31.468200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.468890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:31.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.470190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.470854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:31.470854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.470854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:31.474002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:31.474520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:31.474896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.475316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.475557 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:31.476771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.477307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:31.478432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.478941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:31.479491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.479491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:31.480979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:31.481592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:31.482009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.482375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:31.482646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.483370 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.484939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:31.485450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:36.287752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:36.289213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:36.325410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.325868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.327007 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.328393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.329459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:36.458775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:36.459872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.460244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.460623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.461633 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:36.463664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.464413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:36.465195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:36.465195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:36.465627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.465997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.466923 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:36.468131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.468632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:36.469649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.470212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.470844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:36.470844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.470844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:36.474696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:36.475210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:36.475839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.477471 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:36.478360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.478746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:36.479544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.479970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:36.480520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.480520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:36.481537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:36.481941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:36.482282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.482558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:36.482710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.483285 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.484478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:36.485374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:41.288490 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:41.290152 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:41.292115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:09:41.319624 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.320001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.320966 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.322153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.322900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:41.459424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:41.460565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.460962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.461356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.462221 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.464259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:41.465289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:41.465687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:41.466209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.466539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.467226 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:41.468680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.469650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:41.470547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.471609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:41.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:41.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:41.475933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:41.476425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.476745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.477605 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:41.478757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.479238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:41.480136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.480693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:41.481215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.481215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:41.481959 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:41.482737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:41.483254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.483595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:41.483805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Traceback (most recent call last):
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.484852 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-dd29b152-bcca-432a-b522-fe09e75a7fcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.486179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:41.486725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:46.289255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:46.291056 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:46.325425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.325707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.326539 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.327881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.328670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:46.459862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:46.460905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.461218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.461218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.461855 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.462886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.463926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:46.465359 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:46.465685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:46.466139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.466409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.467012 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:46.468035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:46.469079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.469764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.470401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:46.475710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:46.476434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:46.477061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.477407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.478059 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:46.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.479592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:46.480461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.481029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:46.481619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.481619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:46.482497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:46.483076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:46.483564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.483844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:46.484041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.484625 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.486289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:46.486772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:51.290137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:51.292377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:51.330361 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.330591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.331138 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.332324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.332840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:51.460419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:51.462457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.462686 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.462830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.465819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:51.467133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.468152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.468152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:51.468152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.468152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:51.468771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:51.469491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:51.470138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.470359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.470991 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:51.472338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:51.473513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.474308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.475188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:51.476298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:51.476640 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:51.476958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.477139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.477562 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:51.478186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.478673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:51.479021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.480036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:51.480914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.480914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:51.483048 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:51.483550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:51.484003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.484172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:51.484349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.484871 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.486158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:51.486644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:56.299991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:56.301994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:56.329900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.331215 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.332414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.333002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:56.461495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:56.462834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.463202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.463570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.464494 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.466435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.467804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:56.469232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:56.470110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:09:56.470638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.470980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.471922 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:56.473546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:09:56.475253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.475962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.476746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:56.476746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.476746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:56.476746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:56.477422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:56.477902 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.478131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:09:56.480009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.480703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:09:56.481124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.481817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:56.482577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.482577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:09:56.483571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:09:56.484084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:09:56.484734 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.485149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:09:56.485477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.486231 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.487519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:09:56.487985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:01.300738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:01.302436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:01.337424 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.337809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.338822 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.339794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.340969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:01.462085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:01.463572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.463906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.464293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.465463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.467181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.467864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:01.469737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:01.470256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:01.470951 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.471366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.472533 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:01.473190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.473756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:01.474014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.474475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.474993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:01.474993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.474993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:01.477186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:01.477769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:01.478248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.478537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.479058 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:01.480002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.480444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:01.481142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.481632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:01.482123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.482123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:01.483985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:01.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:01.484895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.485298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:01.485713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.487105 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.488444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:01.488950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:06.301634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:06.303021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:06.340316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.340819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.341754 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.342975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.344060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:06.462684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:06.463908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.464171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.464428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.465149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.466910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.467799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:06.470240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:06.470917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:06.471478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.471784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.472589 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:06.473758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.474722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:06.475205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.476156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.477045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:06.477045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.477045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:06.477714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:06.478356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:06.479103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.479795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.480663 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:06.481236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.481931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:06.482398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.483088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:06.483941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.483941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:06.484398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:06.484811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:06.485220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.485599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:06.485842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.486614 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.488166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:06.489075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:11.302409 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:11.303932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:11.337807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.338187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.339104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.340414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.341159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:11.463353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:11.464482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.464747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.464973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.465742 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.467365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.468483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:11.470728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:11.471426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:11.471861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.472046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.472659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:11.474615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.475207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:11.476166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.476784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.477484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:11.477484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.477484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:11.478226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:11.478979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:11.479474 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.479819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.480592 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:11.482236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.482860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:11.483703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.484323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:11.485001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.485001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:11.485001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:11.485128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:11.485456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.485783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:11.485997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.486648 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.488125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:11.488756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:16.302764 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:16.304377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:16.337359 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.337757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.338741 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.339999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.340959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:16.464089 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:16.465080 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.465387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.465625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.466402 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.468122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.469808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:16.471134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:16.471657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:16.472150 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.472399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.472858 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:16.473737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.474294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:16.475339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.475798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.476290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:16.476290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.476290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:16.478688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:16.479478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:16.479911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.479982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.480635 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:16.481922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.482606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:16.482964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.483558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:16.484078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.484078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:16.485156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:16.485566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:16.485931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.486302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:16.486528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.487160 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.488638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:16.489370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:21.303399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:21.305567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:21.341213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.341608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.342137 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.343333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.343947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:21.464668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:21.466110 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.466740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.467344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.468541 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.470654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.471307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:21.471953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:21.472465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:21.473087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.473219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.473815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:21.474840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.475142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:21.475993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.476470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.476836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:21.476836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.476836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:21.479098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:21.480063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:21.481157 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.481157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.481906 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:21.482756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.483205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:21.484839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.485361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:21.485828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.485828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:21.485828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:21.485918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:21.486193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.486452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:21.486597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.487871 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.488208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:21.488981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:26.304682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:26.306229 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:26.345665 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.346226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.347157 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.348430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.349488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:26.465373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:26.467014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.467398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.467653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.468628 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.470432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.471223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:26.472491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:26.472989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:26.473463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.473658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.474293 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:26.475634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.476119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:26.477171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.477649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.478257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:26.478257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.478257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:26.479994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:26.480387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:26.480737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.480972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.481483 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:26.482285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.482910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:26.484776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.485589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:26.486416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.486416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:26.486416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:26.486599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:26.487043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.487442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:26.487681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.488437 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.490259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:26.490678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:31.305602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:31.308253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:31.342766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.342993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.343591 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.345049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.345438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:31.466144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:31.467252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.467531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.467686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.468474 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.469727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.470260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:31.472900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:31.473441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:31.474790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.475023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.475896 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:31.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.477554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:31.480728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.481246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:31.481838 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.482214 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.482214 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:31.482214 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.482214 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:31.482662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.483281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:31.483827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.484396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:31.484944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.484944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:31.486255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:31.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:31.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.487051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:31.487472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.488698 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.489902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:31.490385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:36.307006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:36.308931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:36.346989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.347412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.348484 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.349804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.350378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:36.466749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:36.467886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.468168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.468471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.469448 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.471103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.472020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:36.473542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:36.474194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:36.474855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.474855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.475720 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:36.476636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.477446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:36.478088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.479692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:36.479692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.479692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:36.480799 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:36.481357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:36.481812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.482107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.482703 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:36.483498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.484021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:36.484575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.485032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:36.485540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.485540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:36.486692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:36.487080 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:36.487451 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.487675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:36.487826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.488332 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.489770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:36.490311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:40.841647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:40.848678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:10:40.848816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:10:40.848890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:40.887676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.887961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.888326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.888424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.890331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.890772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.891334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:40.891334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.891334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:40.891334 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:40.933231 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.933583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.933844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.934034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.934730 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.935768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.936211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.936597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:40.936597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.936597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:40.936597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:40.967548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.968179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.968714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.968907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.969862 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.971251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:40.971587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:40.971975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:40.971975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:40.971975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:40.971975 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:40.999506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:40.999833 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.000378 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.000535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.001552 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.002584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.003086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.003687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:41.003687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.003687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:41.003687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:41.083706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.084037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.084132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.084307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.084440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.085176 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.085646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:10:41.087023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:41.087681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:41.088425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:10:41.196043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.196444 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.196912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.197385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.198328 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.199370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.199911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.200531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:10:41.200531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.200531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:10:41.200531 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Maintenance task: Synchronization completed (took 0.35 seconds)
Apr 02 06:10:41.307625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:41.309373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:41.311096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=434 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:10:41.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.347250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.348085 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.349135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.350042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:41.467524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:41.468717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.469063 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.469337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.470186 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.471978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.473242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:41.474206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:41.474487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:41.475041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.475375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.476104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:41.476897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.477616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:41.478010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.478583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.479349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:41.479349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.479349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:41.481183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:41.481476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:41.481864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.482144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.482741 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:41.484711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.485342 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:41.485731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.486391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:41.487088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.487088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:41.487088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:41.487355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:41.487621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.487829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:41.487982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.488462 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.489530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:41.490180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:46.308301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:46.310061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:46.349483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.349812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.350659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.352398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.353176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:46.468096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:46.469646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.469909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.470181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.471049 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.472860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.473761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:46.474581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:46.475019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:46.475591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.475978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.477019 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:46.478614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.479736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:46.480780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.481567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.482419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.483038 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:46.484491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.485204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:46.485804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.486301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:46.486808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.486808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:46.487478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:46.487780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:46.488009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.488216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:46.488377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.488853 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.490159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:46.490686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:51.308999 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:51.310150 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:51.344533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.344785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.345546 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.346879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.347562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:51.468830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:51.471054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.471671 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.471995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.472962 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.474965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.476152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:51.477224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:51.477224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:51.477224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.477224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.477757 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:51.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.478867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:51.479313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.479689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.480033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:51.480033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.480033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:51.481996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:51.482489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:51.482702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.482898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.483248 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:51.483848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.484279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:51.484827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.485158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:51.485619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.485619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:51.487876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:51.488122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:51.488515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.488737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:51.488875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.489520 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.491904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:51.492393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:56.309840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:56.311439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:56.351831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.352450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.353301 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.354639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.355630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:56.469478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:56.470962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.471219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.471514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.472283 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.474028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.474813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:56.475724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:56.476131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:10:56.476649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.476927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.477670 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:56.478590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.479097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:10:56.479616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.480615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:56.480615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.480615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:56.482670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:56.483210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:56.483741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.484027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.484581 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:10:56.485329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.485756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:10:56.486366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.486834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:56.487376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.487376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:10:56.488281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:10:56.488889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:10:56.489345 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.489661 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:10:56.489858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.490470 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.492025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:10:56.492510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:01.310415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:01.312789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:01.350575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.350848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.351519 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.352974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.353816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:01.470245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:01.472117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.472572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.472895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.473901 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.475083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.476031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:01.476894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:01.476894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:01.477036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.477533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.478291 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:01.479695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.480528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:01.482346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.482811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.483356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:01.483356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.483356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:01.483356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:01.483356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:01.483594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.483847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.484310 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:01.485013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.485465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:01.486082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:01.487092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.487092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:01.488678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:01.489127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:01.489543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.489795 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:01.489934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.490469 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.492100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:01.492638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:06.311112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:06.312751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:06.346786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.347044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.347711 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.348590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.349521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:06.471246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:06.472599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.472906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.473114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.473909 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.475601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.476448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:06.477439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:06.477439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:06.477439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.477605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.478214 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:06.478784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.479257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:06.479546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.479980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.480532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:06.480532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.480532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:06.483392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:06.483677 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:06.483946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.484171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.484943 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:06.485724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.486207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:06.486793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.487328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:06.487855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.487855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:06.489156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:06.489630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:06.489980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.490193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:06.490356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.490802 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:06.492522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:11.311879 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:11.313604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:11.349308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.349916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.350890 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.351816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.352687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:11.471930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:11.473409 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.473760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.474019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.475060 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.477405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.478685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.479554 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:11.480865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.481569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:11.482515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.482961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.483535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:11.483535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.483535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:11.483765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:11.484148 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:11.484607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.484947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.485664 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:11.486841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.487251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:11.488546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.489198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:11.489753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.489753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:11.489753 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:11.490198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:11.490634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.490947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:11.491157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.491901 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.493698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:11.494631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:16.312701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:16.314460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:16.352105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.352540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.353457 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.354338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.355218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:16.472587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:16.473847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.474155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.474449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.475351 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.477098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.477985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:16.478715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:16.478715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:16.479037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.479307 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.480069 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:16.481035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.481552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:16.482231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.482720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.483358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:16.483358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.483358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:16.484093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:16.484732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:16.485290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.485678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.486459 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:16.487918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.488405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:16.489748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.490455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:16.491195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.491195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:16.491195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:16.491710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:16.492247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.492668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:16.492906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.493727 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.495140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:16.496145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:21.313352 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:21.315486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:21.353173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.353614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.354550 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.355851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.356549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:21.473356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:21.474703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.475007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.475562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.476200 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.478314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.478944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:21.479536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:21.479536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:21.479985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.480286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.480975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:21.481920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.482726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:21.483216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.483780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.484309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:21.484309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.484309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:21.484453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:21.484747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:21.485126 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.485473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.486024 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:21.486877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.487545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:21.488236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.488797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:21.489372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.489372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:21.491726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:21.492447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:21.492823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.493083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:21.493289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.493892 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.495237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:21.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:26.314302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:26.315983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:26.356440 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.356898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.357927 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.358809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.359695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:26.473743 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:26.475229 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.475750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.476079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.477230 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.479133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.480093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.481003 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:26.482078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.482594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:26.483100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.483589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.484103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:26.484103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.484103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:26.484786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:26.485027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:26.485985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.485985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.486439 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:26.488415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.488882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:26.490693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.491674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:26.492253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.492253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:26.492253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:26.492729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:26.493083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.493447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:26.493686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.494367 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.496000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:26.496550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:31.315085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:31.316742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:31.359222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.359626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.360557 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.361806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.362601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:31.474480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:31.475833 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.476180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.476494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.477371 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.479504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.480428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:31.481376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:31.481376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:31.481376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.481376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.482119 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:31.482924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.483869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:31.484388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.485186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:31.486111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.486489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.487120 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:31.488218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.488996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:31.490064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.491008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:31.491891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.491891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:31.492583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:31.493000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:31.493484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.493860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:31.494078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.494773 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.496069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:31.496635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:36.315802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:36.317581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:36.356323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.356668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.357841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.359700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.361200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:36.475821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:36.476781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.477192 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.477468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.478525 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.479788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.480602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:36.481488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:36.481488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:36.481488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.481488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.481807 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:36.483102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.483559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:36.485620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.486115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.486662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:36.486662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.486662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:36.486662 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:36.487011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:36.487517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.487887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.488745 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:36.490114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.490572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:36.491981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.492922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:36.495031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.495031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:36.495031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:36.495031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:36.495564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.495768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:36.495907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.496387 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.497424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:36.498031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:41.316634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:41.318258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:41.320115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:11:41.358851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.359151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.359841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.360770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.361707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:41.476227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:41.478033 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.478447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.479400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.479942 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.482199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.483060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:41.483841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:41.483841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:41.483841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.484196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.485216 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:41.486600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.487124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:41.488237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.488785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.489248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.489571 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:41.490276 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.490642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:41.491408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.491849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:41.492335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.492335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:41.493341 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:41.493900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:41.494358 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.494790 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:41.494790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.495465 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.497098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:41.497585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:46.317434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:46.319460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:46.355182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.355580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.356515 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.357760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.358638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:46.477461 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:46.479414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.479687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.479992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.480802 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.481977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:46.483630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:46.483630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:46.483630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.483809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.484375 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:46.485971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.486418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:46.487522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.487899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.488321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:46.488321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.488321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:46.488763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:46.489331 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:46.489580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.489791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.490372 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:46.490955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:46.491754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.492455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.493251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:46.494317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:46.494706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:46.495087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.495508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:46.496093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.496667 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.498400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:46.498909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:51.318238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:51.319492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:51.354289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.354565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.355471 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.356777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.357850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:51.478603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:51.479941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.480123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.480224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.480931 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.482673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.483171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:51.483663 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:51.483663 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:51.484037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.484227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.484786 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:51.485763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.486412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:51.486788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.487216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.487743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:51.487743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.487743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:51.489170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:51.489463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:51.489857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.490087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.490813 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:51.491507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.491944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:51.492617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.493097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:51.493601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.493601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:51.494574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:51.494827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:51.495131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.495377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:51.495521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.495955 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.496785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:51.497334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:56.319234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:56.321246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:56.360072 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.360662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.361649 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.362842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.363835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:56.479596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:56.481067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.481548 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.481898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.482956 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.485050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.485924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.486782 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:56.488083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.488969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:11:56.490069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.490689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:56.491235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.491486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.491956 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:11:56.492525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.492973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:11:56.493246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.493781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:56.494353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.494353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:11:56.494977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:11:56.495434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:11:56.495617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.495825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:11:56.495973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.496636 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.498923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:11:56.499517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:01.319858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:01.321727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:01.356805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.356966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.357586 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.358763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.359376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:01.480254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:01.481740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.482178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.482544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.483429 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.485472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.486417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:01.487354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:01.487354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:01.487354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.487354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.488360 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:01.489903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.491194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:01.492056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.492642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.493434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.493889 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:01.494793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.495397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:01.496229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.496827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:01.497397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.497397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:01.497397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:01.497397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:01.497397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.497578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:01.497767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.498489 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.499743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:01.500626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:06.320405 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:06.322310 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:06.358552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.358945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.359824 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.360991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.361561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:06.481130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:06.482702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.483317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.483450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.484799 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.486501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.486986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:06.487473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:06.487473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:06.487745 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.488366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.488644 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:06.489892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.490446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:06.491606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.492614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:06.493636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.494068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.494834 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:06.495639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.496077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:06.496739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.497205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:06.497810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.497810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:06.497810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:06.497810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:06.497959 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.498370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:06.498613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.499325 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.500162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:06.500694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:11.338637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:11.339201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:11.365032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.365706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.366400 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.367281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.368358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:11.481828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:11.483180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.483614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.483918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.484858 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.486798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.487701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:11.488495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:11.488495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:11.488626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.488913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.489778 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:11.491095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.492068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:11.492710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.493520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.494379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.494915 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:11.496080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.496894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:11.497966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.498487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:11.499008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.499008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:11.499008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:11.499008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:11.499155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.499408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:11.499593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.500433 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.502422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:11.503148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:16.338871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:16.340144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:16.436772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.437163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.437910 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.439066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.439988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:16.482430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:16.483896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.484218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.484505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.485387 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.486863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.487778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:16.488639 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:16.488639 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:16.488940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.489240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.490021 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:16.491193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.492088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:16.492597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.493397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.494206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:16.494206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.494206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:16.494206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:16.494206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:16.494585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.494916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.495791 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:16.497888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.498874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:16.500771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.501264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:16.501899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.501899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:16.501899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:16.501899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:16.502317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.502726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:16.502948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.503743 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.505366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:16.505854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:21.339617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:21.341247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:21.378817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.379380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.380222 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.381112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.382049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:21.483061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:21.484321 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.484759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.484950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.485823 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.487649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.488620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:21.489644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:21.489644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:21.489644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.489644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.490015 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:21.491365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.492121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:21.493050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.493830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:21.494658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.494984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.495176 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:21.496011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.496603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:21.497079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.497640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:21.498157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.498157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:21.501648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:21.502052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:21.502510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.502966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:21.503253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.504095 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.505910 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:21.506503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:26.340257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:26.341920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:26.379085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.379285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.379896 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.381539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:26.511727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:26.511727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:26.511918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:26.512077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:26.514615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:26.515191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:26.515482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:26.515715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.515918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.516034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.516546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.517706 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:26.517888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.518310 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.518681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.519003 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:26.520264 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.520627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:26.521680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.522586 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:26.523477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.524259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:26.525176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:26.525964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:26.527803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.528639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.529538 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.530190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:26.530743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:31.341464 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:31.343358 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:31.370977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.371421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.372324 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.373231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.374552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:31.512891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:31.513180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:31.513256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:31.555589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.555589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.555589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.556469 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.559379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.559846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:31.560236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:31.560236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:31.560699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:31.561197 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.561605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:31.561742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.562379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.562634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Traceback (most recent call last):
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.563052 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:31.564005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.564816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:31.565259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-44bb9926-4ee1-46e9-8395-c6c5e6e5b743 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:31.567013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.567932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:31.568892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:31.569781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.570497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.571433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:31.572444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:31.573025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:31.573559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:31.573559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:31.573559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:36.342239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:36.343610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:36.380606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.381082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.381976 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.382925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.384275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:36.514916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:36.516060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.516526 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.516835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.517771 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:36.519759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.520827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:36.589251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:36.589251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:36.589251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:36.589251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:36.589881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.590789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.590789 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:36.591008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:36.591347 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.591551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.592594 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:36.593876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.594343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:36.594774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:36.596637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.597052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Traceback (most recent call last):
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:36.597508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e7899b3d-427a-43d4-9aed-109a4f4babcf None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.598310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.598830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Traceback (most recent call last):
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.599438 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:36.600141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.600754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-920cae61-0be4-42cf-9c7b-5a7276c7a7a8 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:36.601477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:36.601941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:36.602719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:36.602719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:41.342917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:41.344029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:41.345842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:12:41.377393 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.377803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.378772 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.380548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.381186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:41.515478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:41.516882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.517233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.517555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.518641 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:41.520468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.521189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:41.558508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:41.559048 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:41.559859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.560106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.560911 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:41.561572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:41.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.563847 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:41.564737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.565464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.566227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.566538 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:41.567109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.567844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:41.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.568715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:41.569203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.569203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:41.591167 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:41.592005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:41.593580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.641086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:41.641086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Traceback (most recent call last):
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.641739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5a905a3c-7cb3-4e9a-9aa1-716570a2318a None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.642578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:41.643475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:46.343532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:46.345175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:46.378810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.379212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.380056 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.381049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.381530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:46.516106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:46.517476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.517838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.518180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.519095 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:46.520242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.521156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:46.558998 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:46.559367 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:46.559714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.559848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.560353 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:46.561632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.562433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:46.563174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.563947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.564767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.565215 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:46.565851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.566637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:46.567015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.567475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:46.567925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.567925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:46.591756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:46.592394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:46.592958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.593797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:46.593928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Traceback (most recent call last):
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.595091 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-616a60db-7539-48fc-8716-dd126a040bd5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.596136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:46.597216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:51.344227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:51.346000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:51.380706 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.381147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.382167 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.383458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.384455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:51.516588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:51.517435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.517648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.518059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.518743 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:51.520784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.521541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:51.559607 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:51.560197 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:51.560705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.561023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.561942 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:51.563434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.564230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:51.565147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.566136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.566991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.567491 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:51.568671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.569464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:51.570336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.570813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:51.571359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.571359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:51.592158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:51.592952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:51.593521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:51.594130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.595109 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.597749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:51.598242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:56.345117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:56.346717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:56.385989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.386519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.387584 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.388468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.389395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:56.517366 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:56.518702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.518975 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.519203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.520121 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:56.521854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.522666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:56.560081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:56.560741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:12:56.561364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.561754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.562575 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:56.564024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.564936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:12:56.566529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.567303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:56.568248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.568619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.569330 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:12:56.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.571026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:12:56.572241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.572857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:56.573539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.573539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:12:56.592715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:12:56.593186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:12:56.593610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.594043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:12:56.594279 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.595019 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.596832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:12:56.597403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:01.345805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:01.351134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:01.383183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.383487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.384135 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.385049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.385975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:01.518200 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:01.519599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.520001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.520385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.521363 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:01.522571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.523381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:01.560682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:01.561146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:01.561953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.562451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.563506 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:01.564972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.565811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:01.567004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.567786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.568745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:01.568745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.568745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:01.568745 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:01.568745 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:01.569026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.569515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.570463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:01.571787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:01.573569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.574031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:01.574573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.574573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:01.593115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:01.593974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:01.594434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.594684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:01.594854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.595575 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.597302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:01.597810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:06.346623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:06.348441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:06.381406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.381873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.382497 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.383454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.384434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:06.519572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:06.520684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.521016 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.521288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.522375 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:06.523591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.524596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:06.561198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:06.561746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:06.562202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.562560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.563426 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:06.564846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.565786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:06.566508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.567359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.568328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:06.568328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.568328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:06.568328 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:06.568793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:06.569178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.569458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.570104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:06.571525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.572400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:06.575000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.575000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:06.593741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:06.594231 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:06.594861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.595211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:06.595461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.596407 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.598090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:06.599212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:11.347785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:11.349530 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:11.378978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.379368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.380231 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.381512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.382558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:11.520314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:11.521752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.522087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.522386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.523462 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:11.525295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.526156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:11.561778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:11.562500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:11.563072 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.563455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.564332 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:11.565863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.566855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:11.567781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.568919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.569885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.570855 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:11.571698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.572130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:11.572781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.573245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:11.573753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.573753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:11.594233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:11.594816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:11.595240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.595664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:11.595864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.596690 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.599544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:11.600505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:16.348551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:16.350258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:16.388917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.389386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.390208 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.391129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.392371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:16.521024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:16.522425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.522720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.522882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.523643 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:16.525548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.526355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:16.562565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:16.563214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:16.563959 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.564289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.565231 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:16.566713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.567622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:16.568382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.569174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:16.570129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.570501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.571330 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:16.572652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.573257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:16.574231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.575159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:16.575805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.575805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:16.594806 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:16.595550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:16.596082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.596487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:16.596697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.597706 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.599777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:16.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:21.349317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:21.351098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:21.390480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.390923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.391901 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.393427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.394298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:21.521867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:21.523018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.523199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.523375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.523996 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:21.525145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.525928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:21.563303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:21.563779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:21.564382 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.564707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.565623 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:21.566587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.567495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:21.568287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.569031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.569892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:21.569892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.569892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:21.569892 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:21.570158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:21.570738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.571069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.571866 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:21.573179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.573616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:21.574929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.575459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:21.575981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.575981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:21.595302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:21.595964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:21.596501 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.596866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:21.597130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.598750 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.600854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:21.601655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:26.350210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:26.351712 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:26.386950 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.387216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.387965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.388988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.389883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:26.522646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:26.523976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.524447 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.524567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.525559 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:26.527113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.528667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:26.563799 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:26.564355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:26.564905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.565188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.566399 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:26.566908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:26.568055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.568975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:26.570128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:26.571134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:26.571134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.571510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.572289 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:26.573865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.574731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:26.576162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.576570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:26.576924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.576924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:26.595812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:26.596299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:26.596836 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.597126 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:26.597721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.599894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:26.600752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:31.350997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:31.352705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:31.387473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.387863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.388810 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.390023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.390900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:31.523619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:31.525014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.525303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.525537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.526256 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:31.528201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.529043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:31.564414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:31.564916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:31.565557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.565882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.566820 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:31.568103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:31.569793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.570767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.571598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:31.571598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.571598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:31.571598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:31.571598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:31.571877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.572207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.573039 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:31.574389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.574793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:31.576099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.576633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:31.577135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.577135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:31.596284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:31.596812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:31.597294 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.597651 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:31.597954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.600897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:31.601901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:36.351803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:36.353414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:36.385614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.386019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.386978 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.388165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.389051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:36.524286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:36.525575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.525922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.526210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.527428 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:36.529320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.530108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:36.564943 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:36.565346 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:36.565892 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.566237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.567148 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:36.568677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.569561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:36.571050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.571889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.572816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.573449 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:36.574871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.575296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:36.576763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.577196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:36.577938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.577938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:36.596827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:36.597421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:36.598172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.598652 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:36.598950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.600608 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.602494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:36.603487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:41.352697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:41.355917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:41.356854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:13:41.395319 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.395903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.397022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.398167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.398620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:41.525079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:41.526288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.526646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.526929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.527951 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:41.530107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.531013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:41.565528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:41.565919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:41.566485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.566800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.567850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:41.569751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.570704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:41.571703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.572539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.573502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.573899 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:41.574898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.575432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:41.576578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.577127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:41.577711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.577711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:41.597296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:41.598098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:41.598618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.598988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:41.599225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.599976 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.601006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:41.601956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:46.353337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:46.355685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:46.395516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.395907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.396733 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.397894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.398574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:46.525995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:46.527758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.528154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.528383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.529514 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:46.530920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.531419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:46.566020 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:46.566894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:46.567453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.567805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.568488 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:46.569520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.570350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:46.570812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.571593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.572478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:46.572478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.572478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:46.572478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:46.572716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:46.572953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.573183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.573709 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:46.574531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.574958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:46.575618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.576080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:46.576615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.576615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:46.597909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:46.598797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:46.600418 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.600418 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:46.600418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.600998 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.602631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:46.603065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:51.354175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:51.355397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:51.388584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.389065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.389803 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.391016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.392110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:51.526729 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:51.528085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.528564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.528799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.529587 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:51.530475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.530979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:51.566780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:51.567660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:51.568846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.569130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.570248 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:51.571826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.572687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:51.573858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.574678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.575740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:51.575740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.575740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:51.575740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:51.575740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:51.576232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.576581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.577638 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:51.579045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.579532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:51.580447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.580931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:51.581422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.581422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:51.599146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:51.599920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:51.600632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.601026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:51.601227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.602098 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.603463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:51.604159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:56.355026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:56.356780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:56.395312 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.395649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.396146 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.397211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.397724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:56.527525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:56.528753 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.529248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.529396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.529999 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:56.531049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.531871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:56.567387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:56.568289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:13:56.569032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.569425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.570351 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:56.571947 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.572671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:13:56.573802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.574537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.575334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:56.575334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.575334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:56.575334 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:56.575541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:56.576227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.576768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.577908 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:13:56.578958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.579413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:13:56.580134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.580646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:56.581169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.581169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:13:56.599759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:13:56.600313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:13:56.600869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.601234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:13:56.601505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.602347 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.603477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:13:56.603950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:01.355760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:01.356638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:01.390762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.391604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.392610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.395398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.395921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:01.528317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:01.529417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.529750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.529953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.530835 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:01.532700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.533305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:01.568082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:01.568798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:01.569430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.569730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.570648 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:01.572064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.572627 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:01.573856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.574384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.574994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:01.574994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.574994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:01.575540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:01.576169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:01.576690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.576964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.577680 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:01.579051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.579849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:01.581449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.581921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:01.582428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.582428 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:01.600456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:01.601388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:01.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.602601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:01.602896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.603833 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.605901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:01.606972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:06.356259 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:06.358117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:06.395507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.395882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.397100 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.398441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.399343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:06.528885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:06.529619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.529801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.529944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.530523 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:06.531591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.532352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:06.568614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:06.569477 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:06.570018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.570340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.571088 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:06.572503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.573299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:06.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.574885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.575652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:06.575652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.575652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:06.575908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:06.576560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:06.576977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.577203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.577900 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:06.579559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.579964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:06.581364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.581850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:06.582349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.582349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:06.601482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:06.601938 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:06.602436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.602766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:06.602994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.603887 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.605625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:06.606109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:11.357241 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:11.358923 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:11.389880 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.390127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.390884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.391760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.392347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:11.529491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:11.530660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.530854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.531017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.531706 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:11.533037 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.534152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:11.569171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:11.569810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:11.570337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.570547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.571176 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:11.572495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.573470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:11.574106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.574938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.575908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:11.575908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.575908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:11.576444 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:11.577240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:11.577820 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.578214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.579002 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:11.580071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.580749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:11.581541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.582048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:11.582617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.582617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:11.601981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:11.602593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:11.602997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.603255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:11.603434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Traceback (most recent call last):
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.604069 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-5c57a035-4905-4a9a-9bc5-cb211858784e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.605864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:11.606743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:16.357719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:16.359040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:16.394238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.394518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.395184 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.396219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.396962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:16.530222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:16.531316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.531610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.531888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.532747 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:16.534405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.535424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:16.569632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:16.570203 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:16.570647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.570830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.571424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:16.572886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:16.574601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.575041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.575567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:16.575567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.575567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:16.577019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:16.577801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:16.578313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.578708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.579555 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:16.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.581602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:16.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.583655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:16.584216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.584216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:16.602471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:16.602970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:16.603321 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.603556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:16.603702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.604294 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.605476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:16.606432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:21.358406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:21.360042 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:21.393752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.393957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.394733 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.395574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.396391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:21.531017 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:21.532091 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.532392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.532667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.533554 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:21.535145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.536034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:21.570104 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:21.570699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:21.571301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.571741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.572724 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:21.574008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:21.575606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.576482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.577420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:21.577420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.577420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:21.577649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:21.578299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:21.578910 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.579354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.580208 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:21.581632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.582084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:21.583337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.583846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:21.584394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.584394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:21.603095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:21.603634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:21.604135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.604426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:21.604618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.605240 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.607051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:21.608177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:26.359122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:26.360648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:26.394653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.395079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.396054 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.397320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.397880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:26.532061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:26.533650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.533951 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.534200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.535153 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:26.537109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.537893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:26.570678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:26.571305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:26.571893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.572184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.572989 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:26.574348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.575144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:26.576699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.577507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.578366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:26.578366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.578366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:26.578366 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:26.578683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:26.579132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.579540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.580235 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:26.581518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.581949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:26.583154 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.583671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:26.584284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.584284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:26.603489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:26.603837 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:26.604076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.604306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:26.604526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.604939 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.605896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:26.606718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:31.359615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:31.361327 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:31.395154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.395647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.396644 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.397849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.398785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:31.532853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:31.533817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.534000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.534142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.534927 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:31.536835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.537642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:31.571172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:31.571800 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:31.572421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.572711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.573505 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:31.574861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.576295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:31.576896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.577857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.578944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:31.578944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.578944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:31.578944 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:31.579179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:31.579678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.580243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.580835 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:31.582618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.583094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:31.584389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.584968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:31.585717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.585717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:31.604119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:31.604785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:31.605291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.605634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:31.605848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.606629 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.608349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:31.609135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:36.360583 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:36.361696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:36.396064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.396544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.397391 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.398361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.399515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:36.533678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:36.535114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.535515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.535774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.536834 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:36.538802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.539531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:36.571833 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:36.572451 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:36.572957 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.573251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.574017 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:36.575433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.576550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:36.577045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.577854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.578843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:36.578843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.578843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:36.578974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:36.579552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:36.579911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.580131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.580721 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:36.582009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.582495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:36.583740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.584196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:36.584895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.584895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:36.604717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:36.605182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:36.605679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.606049 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:36.606290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.608844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:36.609409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:41.361335 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:41.362813 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:41.364991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:14:41.401064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.401618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.402690 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.403819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.404734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:41.534292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:41.535609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.535955 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.536195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.537137 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:41.538930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.540127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:41.572384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:41.572948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:41.573422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.573714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.574643 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:41.575557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.576201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:41.576812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.577306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.577901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:41.577901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.577901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:41.579256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:41.579900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:41.580565 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.580565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.580995 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:41.582359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.583406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:41.584210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.585351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:41.586647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.586647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:41.605437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:41.606769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:41.607724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.608248 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:41.608775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.609669 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.610967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:41.611645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:46.362595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:46.364178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:46.399087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.399671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.400400 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.401588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.402779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:46.534942 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:46.536121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.536478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.536672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.537538 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:46.539155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.539911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:46.572946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:46.573406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:46.573991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.574474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.575096 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:46.576483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.577144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:46.578384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.578929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.579546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:46.579546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.579546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:46.579766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:46.580500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:46.580919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.581716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.582155 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:46.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.584328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:46.585145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.585984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:46.586957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.586957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:46.605742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:46.606091 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:46.606556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.607009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:46.607377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.608241 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.609372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:46.610042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:51.363216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:51.364909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:51.392891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.393449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.394439 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.395555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.396669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:51.535727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:51.536905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.537027 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.537118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.537786 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:51.539859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.541009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:51.573486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:51.574158 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:51.574568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.574931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.576022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:51.577556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.578324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:51.579393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.580301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.581153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:51.581153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.581153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:51.581153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:51.581153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:51.581476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.581805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.582707 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:51.584241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.584655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:51.586612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.587065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:51.587586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.587586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:51.606129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:51.606524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:51.607062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.607630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:51.607970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.608839 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.609955 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:51.610794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:56.364035 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:56.364881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:56.395187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.395187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.395674 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.396509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.397487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:56.536476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:56.537888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.538206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.538458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.539501 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:56.541218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.542011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:56.574111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:56.574646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:14:56.575842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.576193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.577065 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:56.578448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.579191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:14:56.579987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.580714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:56.581510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.582297 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:14:56.583548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.584339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:14:56.585196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.586089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:56.586590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.586590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:14:56.606543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:14:56.607046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:14:56.607520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.607770 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:14:56.607976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.608637 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.609948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:14:56.610542 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:01.364519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:01.365962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:01.404559 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.404903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.405932 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.407639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.408800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:01.537239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:01.538478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.538871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.539210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.540182 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:01.541431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.542181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:01.574635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:01.575360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:01.576252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.576667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.577623 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:01.578809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.579732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:01.580496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.581292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:01.582119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.582504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.583246 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:01.584593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.585292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:01.586284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.586772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:01.587291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.587291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:01.607046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:01.607627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:01.608193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.608618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:01.608850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.609650 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.611499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:01.612423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:06.365121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:06.366145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:06.400161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.400851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.401584 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.402774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.403757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:06.537920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:06.539403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.539741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.539998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.541008 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:06.542867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.543668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:06.575375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:06.576054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:06.576702 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.577024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.577886 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:06.579658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.580218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:06.581489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.582004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.582593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:06.582593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.582593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:06.582593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:06.582593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:06.582780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.582998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.583629 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:06.584901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.585394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:06.586636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.587150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:06.587828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.587828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:06.607579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:06.607904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:06.608423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.608778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:06.609007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.609751 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.610874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:06.611577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:11.366040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:11.367631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:11.400034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.400261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.401004 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.402221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.403216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:11.538666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:11.539980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.540483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.540612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.541719 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:11.543539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.544417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:11.576009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:11.576515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:11.576983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.577213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.577927 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:11.579185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.580033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:11.580761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.581529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.582456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:11.582456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.582456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:11.582456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:11.583139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:11.583471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.583834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.584642 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.586489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:11.588048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.588603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:11.589133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.589133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:11.608003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:11.608438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:11.608707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.608922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:11.609094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.609581 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.610906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:11.612248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:16.366524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:16.368423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:16.404377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.404695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.405575 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.406452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.407170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:16.539219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:16.540246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.540510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.540683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.541601 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:16.543491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.544406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:16.576580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:16.577191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:16.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.578093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.578934 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:16.580829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.581546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:16.582751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.583675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.584614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.584891 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:16.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.586090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:16.586701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.587225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:16.587797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.587797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:16.608444 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:16.608891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:16.609300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.609623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:16.609841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.610631 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.612224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:16.613026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:21.367320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:21.368651 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:21.404518 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.404951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.405856 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.407128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.408339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:21.540139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:21.541046 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.541299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.541482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.542499 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:21.544414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.545160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:21.577354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:21.577817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:21.578547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.578863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.579765 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:21.581092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.582551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:21.583081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.583952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.584931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.585408 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:21.586610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.587078 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:21.588423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.588958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:21.589485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.589485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:21.609349 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:21.610389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:21.610922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.610922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:21.611121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.611931 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.613726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:21.614228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:26.368338 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:26.370219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:26.412672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.412940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.413643 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.414918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.415841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:26.540793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:26.542217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.542534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.542774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.543690 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:26.545534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.546381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:26.577811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:26.578257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:26.578819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.579022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.579680 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:26.581006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.581902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:26.582629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.583474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.584541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:26.584541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.584541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:26.584541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:26.584541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:26.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.585164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.585737 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:26.586629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.587230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:26.587662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.588130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:26.588673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.588673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:26.609826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:26.610499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:26.610997 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.611415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:26.611644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.612441 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.614205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:26.615390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:31.368797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:31.370337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:31.402071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.402725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.403691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.404748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.405592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:31.541693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:31.543184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.543589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.543862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.545012 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:31.546982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.547941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:31.578372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:31.578780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:31.579382 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.579769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.580602 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:31.581868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.582690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:31.583494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.584461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.584966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:31.584966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.584966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:31.584966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:31.584966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:31.585403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.585778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.586625 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:31.587961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.588412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:31.589741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.590321 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:31.590958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.590958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:31.610290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:31.610960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:31.611464 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.611981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:31.612309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.613263 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.615691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:31.616642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:36.369602 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:36.370923 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:36.404094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.404670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.405607 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.406479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.407224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:36.542446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:36.543749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.544018 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.544222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.545096 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:36.546811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.548805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:36.578832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:36.579175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:36.579850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.580246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.581177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:36.582400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.583322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:36.583941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.584602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.585132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:36.585132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.585132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:36.585132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:36.585132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:36.585675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.586066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.586805 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:36.587599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.588027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:36.588665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.589157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:36.589782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.589782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:36.610828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:36.611545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:36.612289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.612867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:36.613191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.614232 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.616389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:36.616900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:40.842003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:40.850318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:15:40.850595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:15:40.850595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:40.887365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.887658 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.888008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.888130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.888867 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.890168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.891057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.891717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:40.891717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.891717 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:40.891717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:40.921021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.921455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.922251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.922581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.923459 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.924352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.924958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.925682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:40.925682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.925682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:40.925682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:40.957561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.958109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.959057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.959292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.960058 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.961369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.961965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.962593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:40.962593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.962593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:40.962593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:40.990488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.990846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.991407 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:40.991552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.992364 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.993826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:40.994803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:40.995649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:40.995649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:40.995649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:40.995649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:41.071411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.071776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.072123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.072397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.072666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.073552 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.073907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:15:41.075929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:41.076436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:41.077004 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:15:41.194705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.195191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.195897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.196493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.197521 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:41.198496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.199163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.199863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:15:41.199863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.199863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:15:41.199863 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Maintenance task: Synchronization completed (took 0.35 seconds)
Apr 02 06:15:41.370088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:41.371558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:41.373085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=434 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:15:41.407829 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.408196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.409136 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.410338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.411214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:41.543179 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:41.544877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.545193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.545553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.546480 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:41.548449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.549253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:41.580455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:41.580719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:41.581463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.581726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.582508 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:41.584562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.585259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:41.585659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.586190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:41.586891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.587205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.587727 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:41.588512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.589095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:41.589920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.590567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:41.591253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.591253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:41.611324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:41.611917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:41.612500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.612890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:41.613132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.613963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.615817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:41.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:46.370604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:46.372356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:46.402986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.403254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.403654 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.404767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.405980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:46.543861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:46.545203 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.545619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.545868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.547181 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:46.548728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.549934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:46.581124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:46.581851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:46.582422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.582710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.583504 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:46.584846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.585837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:46.586502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.587365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.588316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.588845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:46.590676 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.591575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:46.592549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.593678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:46.594846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.594846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:46.611881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:46.612574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:46.613173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.613616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:46.614053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.614778 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.616499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:46.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:51.372019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:51.373913 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:51.408066 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.408538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.409536 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.411034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.412220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:51.544619 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:51.545919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.546208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.546499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.547439 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:51.549051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.549588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:51.581760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:51.582635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:51.583156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.583368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.583965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:51.585284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.585827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:51.586932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.587415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.587992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:51.587992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.587992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:51.587992 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:51.587992 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:51.588189 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.588445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.588998 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:51.590332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.590751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:51.591686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.592246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:51.592821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.592821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:51.612508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:51.613185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:51.613670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.614039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:51.614275 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.615320 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.616986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:51.617490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:56.372791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:56.374178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:56.406514 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.406794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.407631 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.408997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.409607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:56.545521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:56.546651 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.546981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.547223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.548174 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:56.549430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.549952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:56.582521 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:56.583288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:15:56.584156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.584571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.585421 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:56.586356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.587178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:15:56.587700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.588616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.589763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.590190 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:15:56.591439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.592402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:15:56.593255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.594030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:56.594555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.594555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:15:56.613090 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:15:56.613864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:15:56.614391 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.614760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:15:56.615006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.615734 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.616935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:15:56.618071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:01.373480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:01.374793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:01.411620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.411995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.412940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.414132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.415309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:01.546253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:01.547730 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.548065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.548357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.549460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:01.550709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.551774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:01.583100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:01.583708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:01.584357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.584733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.585630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:01.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.587594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:01.588724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.589160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.589648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:01.589648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.589648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:01.589648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:01.589648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:01.590054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.590348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.590994 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:01.592433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.592868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:01.594126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.594602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:01.595164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.595164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:01.613744 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:01.614589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:01.615202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.615668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:01.615954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.616885 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.618841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:01.619838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:06.374053 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:06.375162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:06.407844 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.408334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.409204 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.410121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.411020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:06.546868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:06.547983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.548277 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.548475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.549325 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:06.551322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.552194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:06.583824 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:06.584289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:06.584974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.585365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.586287 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:06.587525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.588328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:06.589030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.589880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.590920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.591607 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:06.592424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.593150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:06.593636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.594567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:06.595417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.595417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:06.614252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:06.614946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:06.615479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.615830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:06.616057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.616884 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.618698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:06.619707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:11.374726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:11.375976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:11.406008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.406285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.406951 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.408103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.408936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:11.547532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:11.549181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.549684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.549964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.551253 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:11.553310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.554182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:11.584308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:11.584906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:11.585672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.585973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.586797 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:11.587729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.588195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:11.588816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.589294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.589854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:11.589854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.589854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:11.589854 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:11.590981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:11.591735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.592114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.592959 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:11.594049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:11.595367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.595987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:11.596551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.596551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:11.614709 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:11.615025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:11.615439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.615712 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:11.615909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.616529 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.617733 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:11.618216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:16.375302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:16.376568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:16.413738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.414085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.414972 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.415950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.416915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:16.548320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:16.549638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.549988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.550237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.551225 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:16.552527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.553801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:16.584845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:16.585623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:16.586193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.586567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.587369 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:16.588767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.589327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:16.590544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.590995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.591537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:16.591537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.591537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:16.591537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:16.591537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:16.592724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.593292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.594172 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:16.594933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.595696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:16.596044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.596716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:16.597460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.597460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:16.615257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:16.616171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:16.616719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.617085 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:16.617398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.618283 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.620277 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:16.620747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:21.375950 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:21.377762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:21.412456 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.412721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.413401 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.414322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.415243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:21.549188 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:21.550408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.550751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.550906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.551854 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:21.554161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.554944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:21.585442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:21.585930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:21.586410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.586686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.587422 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:21.588639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.589503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:21.590191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.590854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.591353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:21.591353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.591353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:21.591435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:21.591944 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:21.592512 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.592852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.593643 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:21.595090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.595650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:21.596760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.597438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:21.598011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.598011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:21.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:21.616436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:21.616931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.617283 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:21.617547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.620103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:21.620924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:26.376640 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:26.378378 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:26.413428 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.413827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.414951 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.417400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.419140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:26.549791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:26.551220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.551685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.551936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.552990 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:26.554851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.555685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:26.586177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:26.586647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:26.587350 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.587856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.588762 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:26.590287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.591067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:26.592411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.593096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.593905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.594461 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:26.596019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.596920 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:26.597699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.598694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:26.599324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.599324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:26.616451 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:26.616991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:26.617467 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.617852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:26.618137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.619192 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.620577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:26.621426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:31.377515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:31.378480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:31.405579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.405906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.406820 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.408105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.408807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:31.550595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:31.551925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.552287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.552603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.553646 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:31.555599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.556435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:31.586552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:31.587015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:31.588485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.588485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.588945 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:31.590466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.590949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:31.592736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.594014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:31.594784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.595140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.595675 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:31.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:31.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.600476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:31.601221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.601221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:31.617007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:31.617502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:31.618161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.618586 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:31.618816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.619819 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.620998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:31.621547 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:36.378146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:36.445822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:36.483010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.483830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.484504 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.486588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.487680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:36.551409 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:36.552470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.552885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.553013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.553975 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:36.556095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.556705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:36.586974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:36.587439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:36.587966 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.588301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.589093 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:36.590557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.591082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:36.592180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.592697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.593190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:36.593190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.593190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:36.593970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:36.594420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:36.594928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.595281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.596168 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:36.597206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.597726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:36.598682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.599177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:36.599713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.599713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:36.617685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:36.618434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:36.618700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.618977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:36.619192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.620026 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.621915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:36.622817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:41.378942 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:41.380612 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:41.382708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:16:41.410944 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.411407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.412316 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.413539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.414318 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:41.551964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:41.553294 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.553771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.554018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.555026 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:41.556994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.557476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:41.587606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:41.588228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:41.588864 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.589137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.590041 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:41.591011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:41.592452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.593715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:41.594807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:41.595483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:41.596633 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.596887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:41.600023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.600644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:41.602300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.602965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:41.603656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.603656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:41.618237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:41.618885 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:41.619462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.619843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:41.620099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.620976 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.622694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:41.623528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:46.379478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:46.380470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:46.414050 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.414357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.415223 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.416109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.416944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:46.552491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:46.553435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.553821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.553821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.554641 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:46.556488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.557066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:46.588176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:46.588796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:46.589578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.589578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.590066 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:46.591010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.591777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:46.592438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.593187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.594199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:46.594199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.594199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:46.595023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:46.596011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:46.596137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.596380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.599569 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:46.599892 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.600232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:46.601298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.601803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:46.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:46.618609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:46.618988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:46.619478 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.619710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:46.619853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.620505 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.622332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:46.622815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:51.380251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:51.381951 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:51.416691 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.417117 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.418047 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.419027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.420013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:51.616233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:51.616233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:51.616233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:51.616233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:51.616233 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:51.619438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.619438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.619438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.619438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:51.620623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.621355 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:51.623505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.624032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:51.624636 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.624636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.625056 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.625314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.626053 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:51.626959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.627713 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:51.628657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.629174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:51.629862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:51.630778 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:51.631174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.631873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.632497 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.633644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:51.634183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:56.380948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:56.381979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:56.417925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.418161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.418891 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.419971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.420510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:56.554711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:56.556251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.556524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.556660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.558064 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:56.560016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.560585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:56.589516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:56.590439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:16:56.591196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.591452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.592863 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:56.593147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.593582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:16:56.594298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.594765 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.595111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:56.595111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.595111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:56.595958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:56.596550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:56.596912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.597108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.597573 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:16:56.599289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.599617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:16:56.600452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.600782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:56.601127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.601127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:16:56.620246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:16:56.620764 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:16:56.623362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:16:56.623879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:16:56.624413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:01.382043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:01.382928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:01.417527 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.417891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.418744 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.419901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.420817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:01.555562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:01.557055 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.557365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.557658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.558434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:01.560086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.560592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:01.590341 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:01.591135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:01.592014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.592406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.593442 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:01.594386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.595252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:01.595723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.596475 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.597588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:01.597588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.597588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:01.597588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:01.597588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:01.600404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.600404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.600516 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:01.601616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:01.602685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.603203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.603619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:01.620989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:01.621752 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:01.623906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.623906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:01.623906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.624156 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.625527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:01.626414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:06.382617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:06.384546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:06.417462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.418416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.419357 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.420404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.421177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:06.556236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:06.558288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.558288 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.558288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.558579 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:06.560314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.560873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:06.591218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:06.591218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:06.592311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.592779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.593260 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:06.594422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.595736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:06.596301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.598217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:06.599234 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.599986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.601679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.604097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.604993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:06.621560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:06.622101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:06.622512 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.622768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:06.622924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.624065 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.624647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:06.625361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:11.383841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:11.385479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:11.416472 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.416937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.417805 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.419041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.419710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:11.556857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:11.557921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.558184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.558398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.559015 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:11.560079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.560746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:11.591540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:11.592151 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:11.593154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.593550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.594563 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:11.595408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.595764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:11.596498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.596837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.597218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:11.597218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.597218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:11.597847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:11.598351 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:11.598742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.599007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.599768 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:11.600994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.601312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:11.602586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.603043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:11.603557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.603557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:11.622354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:11.623390 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:11.624072 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.624506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:11.624506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.625207 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.626808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:11.628328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:16.384341 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:16.386253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:16.422053 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.422287 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.423097 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.424621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.425048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:16.557426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:16.558364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.558616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.558833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.559737 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:16.561057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.561565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:16.592149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:16.593029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:16.594168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.594647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.596077 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:16.599806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.600316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:16.601752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.602091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.602466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:16.602466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.602466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:16.602466 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:16.602554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:16.603486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.604160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.604885 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:16.605997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.606331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:16.606871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.607223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:16.607570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.607570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:16.623050 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:16.623557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:16.624650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.625053 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:16.625323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.626397 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.628022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:16.628417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:21.385500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:21.386504 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:21.424365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.424754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.425723 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.427251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.427899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:21.557954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:21.559399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.559759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.560113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.561171 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:21.563010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.564058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:21.592986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:21.593509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:21.594131 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.594587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.595477 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:21.596494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.597393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:21.597850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.598549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.599071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:21.599071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.599071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:21.602647 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:21.603030 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:21.603360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.603671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.604228 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:21.605164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.605807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:21.606716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.607227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:21.607802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.607802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:21.623514 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:21.624314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:21.624840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.625208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:21.625523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.626300 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.628070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:21.629389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:26.386004 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:26.387566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:26.423687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.424134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.425760 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.426642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.427196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:26.558463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:26.559609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.559998 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.560492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.561429 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:26.562283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.563096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:26.593540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:26.594174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:26.595000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.595412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.596460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:26.598080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.598455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:26.599884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.600303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.600809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:26.600809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.600809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:26.603244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:26.603811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:26.604298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.604633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.605437 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:26.607385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:26.607918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.608487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.609083 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:26.624412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:26.624750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:26.625239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.625716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:26.625971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.626702 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.627572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:26.628661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:31.386520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:31.388840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:31.426415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.426804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.427914 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.429469 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.430744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:31.559090 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:31.560609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.561043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.561434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.562588 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:31.564448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.565530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:31.594305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:31.594793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:31.595473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.595922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.597104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:31.599027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.600153 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:31.601335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.602242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.603332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:31.603332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.603332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:31.603758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:31.604230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:31.604731 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.605616 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:31.606518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.606957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:31.607743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.608303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:31.608876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.608876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:31.624807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:31.625386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:31.625773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.625981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:31.626141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.626828 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.628568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:31.629451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:36.387545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:36.389098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:36.424805 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.425214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.426064 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.426962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.427471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:36.559760 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:36.561117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.561449 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.561695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.562840 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:36.564752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.565609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:36.594877 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:36.595337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:36.595927 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.596202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.596987 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:36.598605 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.599728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:36.600573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.601049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.601584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:36.601584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.601584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:36.604076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:36.604357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:36.604858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.605252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.606024 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:36.606837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.607325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:36.607938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.608591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:36.625257 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:36.625765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:36.626448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.626852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:36.627111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.628111 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.629958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:36.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:41.388202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:41.389856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:41.391768 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:17:41.423304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.423745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.424641 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.425522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.426471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:41.560476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:41.561740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.562095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.562405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.563367 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:41.565203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.565971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:41.595376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:41.595980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:41.596646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.597021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.597845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:41.599123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.600878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:41.601418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.601900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.602490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:41.602490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.602490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:41.604437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:41.604728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:41.605187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.605499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.606102 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:41.606949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.607479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:41.607980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.608545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:41.609296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.609296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:41.625726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:41.626213 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:41.626635 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.626989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:41.627243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.628093 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.629644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:41.630531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:46.389445 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:46.391183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:46.423920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.424333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.425256 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.426650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.427176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:46.561217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:46.562581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.562920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.563181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.564350 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:46.566233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.567076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:46.595866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:46.596307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:46.597153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.597603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.598474 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:46.599981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.600899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:46.601963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.602614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.603136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:46.603136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.603136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:46.604879 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:46.606823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:46.606823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.606823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.606946 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:46.608406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.608808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:46.610391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.610818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:46.611315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.611315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:46.626101 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:46.626600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:46.627133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.627500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:46.627716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.628590 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.630539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:46.631453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:51.390519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:51.391931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:51.422737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.423160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.424249 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.425249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.426363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:51.561920 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:51.563525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.563917 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.564306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.565457 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:51.567866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.568839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:51.596430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:51.597098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:51.597786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.598038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.598980 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:51.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:51.601449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.602100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.602710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:51.605386 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:51.605704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:51.606082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.606539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.607070 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:51.608130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.608665 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:51.609354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.609969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:51.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:51.626773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:51.627203 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:51.627696 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.628077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:51.628362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.629115 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.630144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:51.631304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:56.391379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:56.393254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:56.430472 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.430788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.431809 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.433024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.433978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:56.562772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:56.565008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.565491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.566203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.567075 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:56.568987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.569804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:56.597092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:56.597759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:17:56.598522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.598887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.599842 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:56.601424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.602024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:17:56.603110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.604312 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.605594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:56.605594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.605594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:56.605803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:56.606187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:56.606791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.607147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.608067 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:17:56.609465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.610103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:17:56.611088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.611590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:56.612167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.612167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:17:56.627286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:17:56.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:17:56.628574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.628982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:17:56.629420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.630104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.631913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:17:56.632736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:01.391860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:01.393214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:01.431755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.432244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.433025 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.433969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.434981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:01.563601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:01.564879 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.565224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.565563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.566659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:01.568413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.569190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:01.597707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:01.598201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:01.599105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.599440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.600435 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:01.601996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.602795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:01.604423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.605046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.605600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:01.605600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.605600 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:01.606336 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:01.606865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:01.607285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.607549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.608061 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:01.608944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.609355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:01.610007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.610483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:01.610961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.610961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:01.627736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:01.628322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:01.628794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.629105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:01.629446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.630316 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.632069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:01.632710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:06.392544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:06.394089 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:06.431928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.431928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.432493 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.433440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.434151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:06.564564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:06.566571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.567070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.567446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.568759 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:06.570412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.571445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:06.598238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:06.599047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:06.599893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.600661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.601392 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:06.602793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.603541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:06.604622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.605337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.606015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:06.606015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.606015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:06.606884 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:06.607488 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:06.608024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.608434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:06.610280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.610918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:06.611480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.612116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:06.628433 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:06.629413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:06.629933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.630178 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:06.630366 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.631219 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.633319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:06.634315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:11.393430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:11.394763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:11.425106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.425599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.426434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.427329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.428350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:11.565489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:11.567017 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.567437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.567789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.568859 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:11.570807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.572019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:11.598977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:11.599421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:11.600013 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.600351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.601075 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:11.602043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:11.603032 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.604035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.604912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:11.607307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:11.607632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:11.608137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.608522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.609224 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:11.610086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.610548 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:11.611350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.611912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:11.612614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.612614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:11.628932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:11.629976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:11.630534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.630954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:11.631214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.632127 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.634224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:11.635080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:16.394223 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:16.395714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:16.433221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.433563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.434335 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.435653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.437005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:16.566531 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:16.567934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.568285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.568570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.569950 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:16.571836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.573041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:16.599908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:16.600767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:16.601426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.601756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.602615 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:16.604424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.604964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:16.605882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.606354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.606850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:16.606850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.606850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:16.607763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:16.608399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:16.608763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.609016 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.609570 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:16.610494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.610921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:16.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.612065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:16.612607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.612607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:16.629570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:16.630262 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:16.630648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.630876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:16.631023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.631662 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.633519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:16.634439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:21.395095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:21.396759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:21.438381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.438659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.439489 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.440412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.440818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:21.567132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:21.568430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.568766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.569012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.570188 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:21.571534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.572414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:21.600775 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:21.601545 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:21.602193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.602576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.603611 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:21.605200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.605956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:21.607150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.607838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.608558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:21.608558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.608558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:21.608558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:21.608692 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:21.609239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.609588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.610104 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:21.611017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.611450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:21.612073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.612591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:21.613169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.613169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:21.630115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:21.630761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:21.631612 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.632098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:21.632375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.633415 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.635611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:21.636584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:26.395906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:26.397646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:26.431568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.431979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.432798 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.433856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.434953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:26.567865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:26.569187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.569542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.569745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.570618 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:26.571827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.573461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:26.601304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:26.601897 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:26.602873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.603224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.604220 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:26.605196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:26.606403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.607157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.608111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:26.609026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:26.609026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:26.609519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.609728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.610371 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:26.611580 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.612010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:26.613187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.613663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:26.614189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.614189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:26.630818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:26.631141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:26.631906 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.632483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:26.632814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.633855 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.635225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:26.636030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:31.396670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:31.398325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:31.434240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.434666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.435610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.436650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.437562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:31.568648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:31.570114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.570416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.570720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.571737 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:31.573946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.574720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:31.601903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:31.602142 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:31.602761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.603136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.603939 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:31.604601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.605290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:31.605710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.606439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.607236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:31.607236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.607236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:31.609035 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:31.609205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:31.609873 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.610311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.611197 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:31.612683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.613140 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:31.614859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.615341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:31.615875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.615875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:31.631300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:31.631886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:31.632525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.632886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:31.633118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.634094 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.636046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:31.636989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:36.397507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:36.399051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:36.433979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.434459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.435340 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.436385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.436929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:36.569538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:36.570784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.571164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.571521 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.572353 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:36.574396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.575424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:36.602412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:36.602869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:36.603535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.603827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.604352 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:36.605118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:36.605900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.606646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.607532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:36.609445 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:36.609882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:36.610221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.610900 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:36.612400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.612854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:36.614072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.614620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:36.615354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.615354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:36.631754 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:36.632501 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:36.633031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.633581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:36.633729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.634696 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.636617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:36.637147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:41.398313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:41.399819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:41.401556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:18:41.433632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.434015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.434872 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.435885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.437180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:41.570194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:41.571796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.572252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.572656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.573408 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:41.574690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.575181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:41.602878 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:41.603236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:41.604064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.604554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.605588 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:41.607050 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.607592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:41.608963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.609452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.609921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:41.609921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.609921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:41.609921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:41.610244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:41.610668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.610891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.611524 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:41.612828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.613292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:41.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.615161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:41.615661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.615661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:41.632221 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:41.633377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:41.633908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.634372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:41.634716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.635585 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.637699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:41.638670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:46.398947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:46.400613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:46.437449 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.437751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.438405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.439560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.439978 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:46.571139 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:46.572364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.572678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.572975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.573861 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:46.575964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.576604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:46.603605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:46.604069 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:46.604585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.604782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.605396 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:46.606795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.607689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:46.608693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.609464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.610302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:46.610302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.610302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:46.610546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:46.610929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:46.611486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.611931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.612815 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:46.614115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.614853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:46.615943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.616612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:46.617092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.617092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:46.632804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:46.633364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:46.633865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.634370 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:46.634744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.635779 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.637584 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:46.638345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:51.399668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:51.401610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:51.436582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.436890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.437805 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.439295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.440060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:51.571843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:51.573190 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.573632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.573952 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.575040 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:51.576427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.577225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:51.604180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:51.604843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:51.605401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.605692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.606484 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:51.608098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.608669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:51.610085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.611066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:51.612176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.612551 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.613157 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:51.614059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.614915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:51.615485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.616245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:51.616885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.616885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:51.633301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:51.633942 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:51.634346 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.634629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:51.634879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.635696 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.637441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:51.638340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:56.400536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:56.401868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:56.438626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.438808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.439225 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.440145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.441193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:56.572577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:56.573611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.573918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.574160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.575406 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:56.577315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.578124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:56.604841 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:56.605302 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:18:56.605863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.606169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.607048 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:56.608313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.609236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:18:56.610046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.610962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.612039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:56.612039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.612039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:56.612039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:56.612256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:56.612732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.612990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.613618 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:18:56.615021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.615462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:18:56.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.617505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:56.618006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.618006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:18:56.633750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:18:56.634352 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:18:56.634983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.635434 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:18:56.635678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.636527 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.637736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:18:56.638604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:01.401792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:01.403232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:01.445839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.446133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.446707 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.448288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.448942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:01.572995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:01.574180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.574634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.574973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.575940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:01.577721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.578697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:01.605600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:01.606703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:01.607343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.607623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.608257 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:01.609209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.610109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:01.610659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.611485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.612556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:01.612556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.612556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:01.612556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:01.612784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:01.613191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.613454 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.614158 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:01.615519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:01.617123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.617602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:01.618164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.618164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:01.634398 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:01.635106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:01.635655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.636060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:01.636375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.637377 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.639419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:01.640256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:06.402312 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:06.404111 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:06.436000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.436460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.437149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.438026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.439209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:06.573605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:06.575458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.575458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.575458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.575814 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:06.577810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.579295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:06.606556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:06.607236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:06.607884 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.608061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.608664 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:06.609992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.610800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:06.611664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.612473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:06.613219 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:06.613549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.614190 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:06.615121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.615793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:06.616555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.617043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:06.617478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.617478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:06.634894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:06.635577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:06.636281 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.636710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:06.636942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.637911 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.640243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:06.641069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:11.403169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:11.404354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:11.438308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.438685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.439138 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.440132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.441356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:11.574251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:11.575689 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.575985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.576248 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.577191 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:11.579592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.580523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:11.607103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:11.607979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:11.608584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.608876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.609754 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:11.611146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.612055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:11.613156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.613984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.614936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.615498 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:11.617299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.618201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:11.619229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.620593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:11.621703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.621703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:11.635476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:11.636017 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:11.636528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.636892 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:11.637136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.638071 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.639924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:11.640954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:16.403802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:16.406300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:16.444099 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.444526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.445336 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.446430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.447059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:16.574982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:16.576457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.576740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.576983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.577893 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:16.579903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.580774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:16.607796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:16.608308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:16.609404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.609685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.611297 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:16.612823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.614148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:16.614698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.615574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:16.616463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.616924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.617583 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:16.619013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.619453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:16.620202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.620719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:16.621217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.621217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:16.635931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:16.636627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:16.637099 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.637494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:16.637787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.638575 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.640218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:16.641432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:21.404611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:21.405894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:21.436625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.437004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.437931 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.438880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.439334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:21.575780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:21.577129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.577555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.577555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.578495 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:21.580401 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.581162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:21.608305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:21.608969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:21.609719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.610107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.610979 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:21.612516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.613316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:21.614481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.615314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.616174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:21.616174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.616174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:21.616174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:21.616174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:21.616807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.617158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.617926 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:21.619253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.619750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:21.620883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.621380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:21.621893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.621893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:21.636439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:21.636855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:21.637422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.637791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:21.638018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.639160 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.640922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:21.641706 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:26.405427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:26.406591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:26.446025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.446232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.446802 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.448666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.449815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:26.576598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:26.578050 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.578483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.578730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.579854 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:26.581720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.582831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:26.608862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:26.609204 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:26.609797 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.610210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.611131 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:26.612052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.612925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:26.613577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.614259 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.615122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:26.615122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.615122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:26.616064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:26.616550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:26.617493 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.617493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.618434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:26.619613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.619974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:26.621301 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.621673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:26.622158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.622158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:26.636921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:26.637296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:26.637818 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.638174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:26.638440 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.639233 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.640880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:26.641688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:31.406176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:31.407227 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:31.445606 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.446007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.446869 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.447813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.448806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:31.577330 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:31.578787 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.579137 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.579502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.580424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:31.581649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.583209 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:31.609376 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:31.609870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:31.610579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.610902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.611968 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:31.613682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.614223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:31.615736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.616263 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.616923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:31.616923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.616923 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:31.616923 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:31.617440 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:31.617991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.618420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.619455 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:31.620080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.620514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:31.621290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.621866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:31.622648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.622648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:31.637399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:31.637861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:31.638483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.638884 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:31.639216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.640216 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.641969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:31.642954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:36.406940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:36.408556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:36.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.443519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.444338 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.445532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.445878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:36.578052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:36.579491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.579941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.580179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.581149 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:36.583280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.584088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:36.609740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:36.610287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:36.611154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.611522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.612831 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:36.614493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.615187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:36.616099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.617012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.617990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:36.617990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.617990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:36.617990 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:36.617990 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:36.618644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.619077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.619856 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:36.621278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.622024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:36.623025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.623781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:36.624699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.624699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:36.637921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:36.638682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:36.639202 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.639574 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:36.639810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.640630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.642973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:36.643876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:41.408034 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:41.409577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:41.411402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:19:41.443953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.444387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.445386 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.448949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.449528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:41.578803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:41.580149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.580568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.580777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.581679 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:41.583430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.584124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:41.610360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:41.610978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:41.611500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.611681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.612476 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:41.614088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.615107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:41.615794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.616365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.617156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:41.617156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.617156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:41.617863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:41.618211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:41.618506 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.618725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.619180 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:41.620024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.620672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:41.621394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.621903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:41.622450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.622450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:41.638529 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:41.639557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:41.640206 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.640520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:41.640759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.641720 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.643995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:41.645167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:46.408627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:46.409902 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:46.449255 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.449683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.450615 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.451741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.452610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:46.580036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:46.581185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.581416 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.581806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.582404 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:46.583171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.584075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:46.611200 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:46.611579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:46.612355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.612670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.613805 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:46.615239 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.616348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.617817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.618668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:46.618668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.618668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:46.618668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:46.618668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:46.618958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.619043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.619688 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:46.620116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.620433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:46.620891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.621324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:46.621684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.621684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:46.639436 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:46.640201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:46.640762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.641171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:46.641441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.642334 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.644222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:46.645520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:51.409184 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:51.410954 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:51.448800 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.449082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.449759 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.450825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.451903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:51.580751 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:51.582016 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.582286 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.582576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.583472 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:51.585178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.586044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:51.611684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:51.612356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:51.612956 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.613376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.614216 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:51.615506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.616394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:51.617219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.618014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.618886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:51.618886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.618886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:51.618886 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:51.619599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:51.620258 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.620689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.621576 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:51.622864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.623754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:51.624550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.625391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:51.626857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.626857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:51.640052 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:51.640660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:51.641088 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.641355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:51.641478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.642021 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.643223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:51.644102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:56.409987 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:56.411077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:56.444983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.445441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.446466 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.448457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.449066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:56.581495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:56.583193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.583608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.583856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.584963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:56.587125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.588149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:56.612187 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:56.612861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:19:56.613613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.613983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.614850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:56.615889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.616930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:19:56.617456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.618326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.619224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:56.619224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.619224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:56.619452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:56.619918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:56.620355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.620715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.621418 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:19:56.622573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.623360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:19:56.624234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.624820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:56.625364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.625364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:19:56.640593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:19:56.641307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:19:56.641875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.642200 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:19:56.642451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.643200 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.644378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:19:56.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:01.410858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:01.412828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:01.451353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.451736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.452657 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.453563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.454644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:01.583374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:01.584887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.585216 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.585508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.586616 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:01.588704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.589545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:01.613310 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:01.613977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:01.614735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.615041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.615982 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:01.617569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.618388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:01.619309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.620020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:01.621045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.621438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.622245 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:01.623147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:01.624231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.624714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:01.625202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.625202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:01.641317 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:01.642065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:01.642483 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.642804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:01.642941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.643553 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.645405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:01.646567 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:06.411485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:06.413204 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:06.448060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.448164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.448840 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.449770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.450085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:06.584042 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:06.585007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.585709 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.585709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.586405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:06.588065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.588587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:06.613930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:06.614569 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.616609 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:06.618483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.619226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:06.619715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.620498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:06.621373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.621680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.622216 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:06.623611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:06.624981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.625849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:06.641856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:06.642804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:06.643246 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.643517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:06.643673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.644451 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.646908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:06.647730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:11.412343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:11.413589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:11.450926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.451391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.452278 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.453497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.454226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:11.584590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:11.585556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.585814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.586043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.586873 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:11.588450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.589221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:11.614306 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:11.614977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:11.615629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.615937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.616827 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:11.618213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.619228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:11.620012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.621570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:11.621570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.621570 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:11.621570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:11.621570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:11.622087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.622471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.623282 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:11.624708 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.625155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:11.626748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.627720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:11.628336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.628336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:11.642406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:11.642761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:11.643112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.643390 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:11.643462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.644006 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.645438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:11.645935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:16.413551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:16.415160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:16.452622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.452816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.453282 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.454151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.454957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:16.585112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:16.586134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.586448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.586691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.587655 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:16.589716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.590638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:16.615065 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:16.616130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:16.616859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.617195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.618394 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:16.619852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.620458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:16.621489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.621975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:16.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:16.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:16.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:16.622845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.623220 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.624011 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:16.625033 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.625462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:16.626227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.626799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:16.627412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.627412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:16.642750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:16.643384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:16.643931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.644289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:16.644596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.645473 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.647181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:16.648006 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:21.413812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:21.416852 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:21.450605 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.450786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.451238 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.452145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.452670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:21.585662 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:21.586867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.587244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.587549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.588575 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:21.590441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.591249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:21.615712 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:21.616109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:21.616963 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.617465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.617919 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:21.618721 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.619597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:21.620069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.622027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:21.622027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.622027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:21.622402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:21.622962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:21.623402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.623645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.624347 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:21.626005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.626523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:21.628699 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.629181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:21.629688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.629688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:21.643314 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:21.644059 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:21.644791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.645242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:21.645536 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.646461 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.649020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:21.649845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:26.415820 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:26.418543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:26.457965 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.458374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.459345 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.460514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.461514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:26.586332 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:26.587705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.588047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.588386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.589315 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:26.591099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.591691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:26.616162 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:26.616593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:26.617247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.617511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.618480 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:26.619827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.621167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:26.621855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.622918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.624120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.624841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:26.626123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.626695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:26.628011 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.628487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:26.628985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.628985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:26.643867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:26.644415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:26.644720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.644935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:26.645077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.645680 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.647885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:26.648456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:31.417465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:31.419748 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:31.453323 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.453828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.454783 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.456021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.457041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:31.587151 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:31.588549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.588815 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.588982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.590144 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:31.591743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.592695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:31.616631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:31.617177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:31.617846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.618189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.618877 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:31.620038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.620734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:31.621795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.622330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.622834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:31.622834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.622834 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:31.623155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:31.623784 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:31.624417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.624692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.625170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:31.625904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.626483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:31.626990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.627674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:31.628464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.628464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:31.644348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:31.644771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:31.645222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.645632 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:31.645855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.646604 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.648223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:31.649328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:36.418341 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:36.419888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:36.452810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.453012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.453726 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.454540 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.455617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:36.587801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:36.588991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.589399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.589658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.590569 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:36.592459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.593319 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:36.617096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:36.617475 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:36.617779 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.617967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.618453 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:36.619186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.619984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:36.620497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.621410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.622343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:36.622343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.622343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:36.623549 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:36.624185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:36.624630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.624839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.625431 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:36.626764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.627260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:36.628592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.629073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:36.629617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.629617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:36.644773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:36.645305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:36.645796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.646205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:36.646514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.647311 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.648926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:36.649826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:40.842961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:40.854801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:20:40.854941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:20:40.855082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:40.899450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.899893 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.900495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.900684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.901621 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.902596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.903236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.903957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:40.903957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.903957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:40.903957 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:40.933201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.933498 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.933924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.934192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.934969 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.936230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.936961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.937526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:40.937526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.937526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:40.937526 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:40.961371 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.961792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.962388 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.962613 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.963405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.964378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.964899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.965553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:40.965553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.965553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:40.965553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:40.995494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.995851 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.996414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:40.996599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.997422 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.998597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:40.999223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:40.999919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:40.999919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:40.999919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:40.999919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:41.079191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.079758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.079994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.080230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.080476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.081361 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.081755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:20:41.083136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:41.083738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:41.084427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:20:41.194144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.194695 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.195290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.195719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Traceback (most recent call last):
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.196714 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:41.197603 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.198413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.199257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:20:41.199257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.199257 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:20:41.199257 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-f370ffc5-ffbe-4674-b212-505eedca4464 None None] Maintenance task: Synchronization completed (took 0.34 seconds)
Apr 02 06:20:41.419149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:41.420819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:41.422716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=434 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:20:41.450414 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.450562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.451250 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.452299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.453157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:41.588458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:41.589916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.590294 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.590645 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.591599 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:41.594228 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.594938 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:41.617578 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:41.618169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:41.618820 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.619112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.619942 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:41.621543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.622185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:41.623659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.624470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.625379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.626056 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:41.627210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.627619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:41.628285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.628707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:41.629172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.629172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:41.645209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:41.645711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:41.646172 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.646537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:41.646759 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.647593 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.649144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:41.649942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:46.419728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:46.421593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:46.456972 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.457238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.457904 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.458768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.459792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:46.589232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:46.590420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.590680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.590911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.592060 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:46.593903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.594860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:46.618100 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:46.618599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:46.619621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.619800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.620840 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:46.622053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.622608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:46.623823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.624320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.624858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:46.624858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.624858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:46.624858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:46.625108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:46.625629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.626062 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.626857 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:46.628244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:46.630073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.630560 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:46.631086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.631086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:46.645731 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:46.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:46.646676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.647024 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:46.647429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.648018 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.649625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:46.650501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:51.421584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:51.421995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:51.455832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.456461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.457199 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.458378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.458967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:51.589773 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:51.591650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.591650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.592025 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.592844 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:51.594718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.595407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:51.618495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:51.619127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:51.620762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.621096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.622080 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:51.623049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.624028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:51.624504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.625360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.626201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:51.626201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.626201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:51.626201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:51.626201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:51.626561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.626561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.627236 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:51.627993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.628714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:51.629132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.630098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:51.631027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.631027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:51.646262 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:51.647550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:51.647724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.648081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:51.648365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.649109 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.650866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:51.651471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:56.422006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:56.423715 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:56.453989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.454522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.455557 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.456531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.457511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:56.590443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:56.591839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.593103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.593564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.594739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:56.596192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.596941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:56.619136 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:56.619720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:20:56.620524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.620860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.621865 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:56.623572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.624772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:20:56.625962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.626653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.627214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:56.627214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.627214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:56.627214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:56.627214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:56.627489 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.627845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.628685 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:20:56.630234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.630687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:20:56.632751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.633311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:56.633860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.633860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:20:56.646876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:20:56.647413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:20:56.647908 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.648284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:20:56.648574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.649433 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.651214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:20:56.652049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:01.422646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:01.424194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:01.458254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.458527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.459053 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.459850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.461003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:01.591071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:01.592566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.592869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.593101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.594022 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:01.595890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.596427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:01.619587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:01.620210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:01.620845 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.621193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.622135 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:01.623618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.624493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:01.625378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.626436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.627404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:01.627404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.627404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:01.627404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:01.627404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:01.627681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.628105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.628819 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:01.630137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.630588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:01.631924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.632403 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:01.632862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.632862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:01.647292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:01.647975 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:01.648573 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.648992 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:01.649284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.650151 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.651983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:01.652837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:06.423324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:06.425240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:06.461734 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.462144 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.462988 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.463974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.464418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:06.591612 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:06.592629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.592806 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.592924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.593555 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:06.594445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.595130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:06.620304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:06.620839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:06.621595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.621941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.622949 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:06.624529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.625402 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:06.626240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.627034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:06.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:06.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:06.627895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:06.628245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.628553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.629390 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:06.630634 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.631172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:06.632509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.633042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:06.633610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.633610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:06.647791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:06.648307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:06.648772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.649132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:06.649519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.650194 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.651087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:06.651944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:11.424304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:11.425587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:11.462887 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.463334 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.464299 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.465640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.466648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:11.592425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:11.593598 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:11.635550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.636354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:11.637532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:11.638293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:11.638293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.638293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.638293 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.638556 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:11.638991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:11.639852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:11.640435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:11.641166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.641675 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:11.642167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.642700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:11.643221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.643757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:11.644333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.644333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:11.648157 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:11.648528 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:11.648905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.649183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:11.649411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.650000 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.651740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:11.652088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:16.424882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:16.426432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:16.466305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.466875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.468023 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.468743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.469750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:16.593045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:16.594431 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.594671 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.594898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.595745 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:16.597780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.598623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:16.637093 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:16.637984 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:16.638860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.689906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.690681 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:16.691654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:16.692014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:16.692964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.693431 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:16.693777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:16.694008 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.694222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.694691 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:16.694948 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:16.695787 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:16.696124 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:16.696995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.697336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.697672 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.698864 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:16.699387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:21.425700 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:21.427680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:21.468291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.468715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.469782 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.471729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.472692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:21.593762 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:21.595030 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.595369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.595601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.596541 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:21.598380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.600092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:21.637836 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:21.638452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:21.639012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.639291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.640047 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:21.641506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.642468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:21.643231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.644015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.644870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:21.644870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.644870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:21.740470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:21.740470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:21.740724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:21.741182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:21.741682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.743306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.743832 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:21.744722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:21.745195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:21.746052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.746620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:21.747182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.747182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:21.747182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:21.747182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.747348 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.748339 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:21.748843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:26.426537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:26.428175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:26.464145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.464446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.465458 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.466644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.467755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:26.594589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:26.595869 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.596209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.596516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.597500 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:26.599735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.600538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:26.638452 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:26.639140 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:26.639793 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.640190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.641204 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:26.642601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.643388 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:26.644192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.644999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.645878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:26.645878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.645878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:26.741019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:26.741300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:26.741828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:26.742750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:26.785356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.785356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.785894 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:26.786763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:26.787108 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:26.787899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.788252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:26.788655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.788655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:26.788655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:26.788655 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Traceback (most recent call last):
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.788792 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-4bcdc656-3650-4718-8722-74e95b8e596c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.790332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:26.790674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:31.427014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:31.428629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:31.469601 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.470018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.471114 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.472203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.473102 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:31.595304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:31.596891 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.597301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.597660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.598585 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:31.600468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.601166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:31.639025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:31.639512 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:31.640118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.640494 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.641227 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:31.642571 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.643253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:31.644147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.644944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.645808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:31.645808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.645808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:31.741949 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:31.742363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:31.742781 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:31.743553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:31.744086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.744477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.745235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.745971 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:31.746454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:31.748085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:31.748885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:31.750856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.751543 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.753178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:31.753747 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:36.427835 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:36.429417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:36.462377 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.462758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.463636 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.465280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.466193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:36.595941 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:36.597250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.597484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.597654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.598558 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:36.601260 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.601962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:36.639540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:36.640298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:36.641007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.641375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.642226 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:36.644070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.645134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:36.646218 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.647040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:36.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:36.742471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:36.743076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:36.743755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.744139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.744608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.745288 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:36.746424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:36.747176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:36.748155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.749053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.749977 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.751802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:36.752335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:41.428298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:41.430171 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:41.432086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:21:41.463193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.463430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.463956 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.464912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.465888 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:41.596557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:41.597688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.598114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.598466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.599482 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:41.601175 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.602143 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:41.640432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:41.640976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:41.641798 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.642211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.643190 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:41.644161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.645131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:41.645736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.646509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.647340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:41.647340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.647340 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:41.743320 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:41.743978 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:41.744740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.745296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.746260 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:41.747367 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.748211 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:41.748649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:41.750409 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:41.751616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:41.753221 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.753928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:41.754637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.754637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:41.754637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.755355 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.756823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:41.757528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:46.428890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:46.430626 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:46.464105 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.464323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.464840 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.465716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.466636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:46.597176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:46.598554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.598868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.599022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.600000 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:46.601573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.602731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:46.641134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:46.642530 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:46.643292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.643652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.644629 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:46.646090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.647061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:46.648039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.648995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.649948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:46.649948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.649948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:46.744057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:46.744443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:46.745000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.745436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.746136 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:46.746815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.747598 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:46.748001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.748784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:46.749735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.750399 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:46.752133 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:51.429662 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:51.431148 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:51.465217 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.465639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.466585 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.467862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.468800 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:51.597857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:51.599812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.600041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.600233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.601137 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:51.603451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.603971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:51.641587 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:51.642290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:51.643039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.643355 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.644293 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:51.645639 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.646065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:51.647462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.647928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.648563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:51.648563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.648563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:51.744807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:51.746485 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:51.746745 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.747194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.748151 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:51.749826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:51.750690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:51.751799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.752904 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.754026 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:51.754828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:51.755805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:56.430324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:56.431796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:56.477337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.478232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.478850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.480327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.481705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:56.598555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:56.600011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.600379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.600657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.601705 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:56.603528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.604446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:56.642355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:56.643013 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:21:56.643609 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.643942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.644785 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:56.646196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.646982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:21:56.648007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.648877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.649651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:56.649651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.649651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:56.745728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:56.746802 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:56.747674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.748103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.749098 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:21:56.750439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.751327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:21:56.752552 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.753327 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:56.754074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.754074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:21:56.754074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:21:56.754074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:21:56.754074 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.754374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:21:56.754474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.755150 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.756230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:21:56.756723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:01.430903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:01.432047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:01.468196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.468628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.469534 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.470496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.471305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:01.599417 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:01.601446 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.601931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.602186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.603054 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:01.605446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.605986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:01.643128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:01.643584 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:01.644410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.644757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.645853 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:01.647255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.648093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:01.649003 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.649901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.650837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:01.650837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.650837 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:01.746300 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:01.746919 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:01.747687 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.748193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.749219 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:01.750794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.751583 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:01.752815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.753678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:01.754530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.754530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:01.754530 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:01.754530 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:01.754780 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.754969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:01.755124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.755653 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.756704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:01.757219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:06.431630 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:06.433186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:06.471322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.471777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.472610 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.473813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.474566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:06.600369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:06.602318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.602890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.603010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.603921 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:06.605948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.606726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:06.643957 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:06.644562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:06.644981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.645166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.645749 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:06.646465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:06.647360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.648035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.648879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:06.746931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:06.747550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:06.748333 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.748788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.749667 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:06.750939 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.751861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:06.752668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.753680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:06.754943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.754943 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:06.754943 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:06.755465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:06.755875 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.756193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:06.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.757119 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.759213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:06.759785 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:11.432520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:11.434010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:11.465981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.466368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.467315 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.468465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.469303 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:11.601308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:11.602553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.602825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.603115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.603835 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:11.605903 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.606817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:11.644560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:11.645035 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:11.645638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.646048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.646937 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:11.648462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.649165 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:11.650562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.651492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.652455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:11.652455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.652455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:11.747774 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:11.748620 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:11.749420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.749953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.750993 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:11.751742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.752217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:11.752827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.753214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:11.753651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.753651 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:11.755222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:11.755679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:11.755961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.756212 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:11.756385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.757170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.757905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:11.758457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:16.433350 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:16.435039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:16.468507 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.468906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.469830 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.470880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.471932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:16.601927 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:16.602988 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.603251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.603479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.604297 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:16.605893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.606505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:16.645244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:16.646402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:16.646961 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.647413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.648425 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:16.649989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:16.650921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.651493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.651979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:16.748614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:16.749250 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:16.750075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.750541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.751416 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:16.752488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.753219 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:16.753701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.754519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:16.755363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.755363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:16.756003 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:16.756782 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:16.757289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.757763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:16.758001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.759070 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.761182 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:16.761707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:21.434006 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:21.435363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:21.469165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.469471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.470155 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.471554 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.472365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:21.602801 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:21.603847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.604067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.604181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.604810 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:21.605987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.606741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:21.646473 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:21.647121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:21.647952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.648295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.649181 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:21.650235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.651106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:21.651768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.652256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.652805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:21.652805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.652805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:21.749254 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:21.750061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:21.750847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.751399 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.752659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:21.753988 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.754760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:21.756125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.757019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.758026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:21.758395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.759071 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.760681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:21.761202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:26.434671 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:26.436229 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:26.469009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.469391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.470121 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.471001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.472123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:26.603460 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:26.604827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.605245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.605796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.606630 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:26.607814 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.608347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:26.647185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:26.647861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:26.648585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.648898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.649842 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:26.651172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.652545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:26.652994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.653991 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.655001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:26.655001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.655001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:26.749889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:26.750597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:26.751073 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.751372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.752315 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:26.753767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.754509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:26.755589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.756433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:26.757194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.757194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:26.757194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:26.757484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:26.757843 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.758119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:26.758345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.758887 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.760251 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:26.760757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:31.435245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:31.437117 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:31.470154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.470517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.471261 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.472246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.472711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:31.604220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:31.605557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.605911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.606104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.607049 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:31.608535 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.609652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:31.647777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:31.648199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:31.649109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.649569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.650585 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:31.652038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.652959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:31.653828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.654641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.655490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:31.655490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.655490 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:31.750591 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:31.751540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:31.752380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.752868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.753963 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:31.755987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.756870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:31.758069 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.759090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.760132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.760643 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.761058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:31.761642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:36.436029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:36.437170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:36.471855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.472289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.473237 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.474208 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.474773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:36.604750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:36.605809 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.606083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.606240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.606985 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:36.608642 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.609137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:36.648572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:36.649130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:36.649935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.650291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.651233 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:36.652616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.653393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:36.654157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.654959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.655852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:36.655852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.655852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:36.751251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:36.751974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:36.752830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.753225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.754157 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:36.755658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.756390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:36.757825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.758949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:36.759931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.759931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:36.759931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:36.759931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:36.759931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.760352 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:36.760352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.761204 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.763131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:36.764249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:41.436776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:41.438102 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:41.440038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:22:41.470305 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.470788 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.471715 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.472826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.474094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:41.605443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:41.606570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.606868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.607029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.607850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:41.610396 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.610950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:41.649083 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:41.649455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:41.650130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.650499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.651452 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:41.652859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.653808 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:41.654456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.655329 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.656206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:41.656206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.656206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:41.751981 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:41.752693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:41.753560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.754125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.755051 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:41.756320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.757053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:41.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.758636 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:41.759487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.759487 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:41.759487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:41.759900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:41.760415 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.760672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:41.760819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.761369 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.762347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:41.762869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:46.437389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:46.439070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:46.473765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.474172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.475155 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.477002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.477957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:46.606159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:46.607858 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.608165 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.608341 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.609042 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:46.610439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.611184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:46.649570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:46.649968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:46.650534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.650760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.651497 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:46.652178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.652966 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:46.653510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.654357 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.655292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:46.655292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.655292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:46.752785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:46.753292 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:46.754040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.754474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.755582 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:46.758413 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.759315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:46.760101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.760846 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.761698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:46.762044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.762370 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.763657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:46.764524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:51.438132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:51.440411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:51.476740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.476906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.477597 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.478501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.479049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:51.607567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:51.608853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.609156 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.609443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.610359 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:51.612199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.612709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:51.650041 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:51.650825 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:51.652191 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.652563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.653420 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:51.655070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.656386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:51.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.658500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.659514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:51.659514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.659514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:51.753577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:51.754056 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:51.754911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.755292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.756114 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:51.757612 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.758483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:51.759549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.760345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:51.761128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.761128 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:51.761128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:51.761235 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:51.761690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.762036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:51.762281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.763056 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.764161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:51.765002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:56.438928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:56.442804 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:56.477135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.477509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.478423 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.479815 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.481031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:56.608229 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:56.609389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.609754 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.610049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.610964 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:56.612369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.613895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:56.651012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:56.651685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:22:56.652643 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.653047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.653777 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:56.654737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.655705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:22:56.656207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.657204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.658497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:56.658497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.658497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:56.754463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:56.755208 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:56.756236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.756740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.757792 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:22:56.759199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.759918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:22:56.761034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.761795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:56.762581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.762581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:22:56.762581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:22:56.762581 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:22:56.762809 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.763017 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:22:56.763235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.764081 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.765813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:22:56.766302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:01.441937 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:01.443717 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:01.480345 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.480872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.481845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.482724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.483461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:01.608989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:01.610256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.610657 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.610956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.612111 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:01.613393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.614349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:01.651653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:01.652291 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:01.653146 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.653575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.654678 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:01.656087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.656926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:01.657709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.658574 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.659462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:01.659462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.659462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:01.755232 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:01.755744 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:01.756590 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.756992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.757946 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:01.759404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.760443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:01.761298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.762059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:01.763094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.763094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:01.763094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:01.763094 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:01.763363 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.763556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:01.763686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.764298 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.766703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:01.767425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:06.443092 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:06.444392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:06.483903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.484204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.484937 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.486242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.487258 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:06.609629 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:06.610771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.611026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.611225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.612161 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:06.613698 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.614515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:06.652443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:06.652982 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:06.653627 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.653959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.654789 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:06.656021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.656901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:06.657674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.658477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.658956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:06.658956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.658956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:06.756000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:06.756432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:06.757355 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.757760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.758779 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:06.759730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.760519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:06.760884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.761509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:06.762148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.762148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:06.762561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:06.763297 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:06.763872 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.764383 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:06.764786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.765544 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.766701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:06.767537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:11.443718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:11.445837 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:11.484102 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.484555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.485427 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.486371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.487872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:11.610290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:11.611979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.612455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.612768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.613841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:11.615064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.616071 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:11.653082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:11.653678 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:11.654225 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.654579 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.655738 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:11.657429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.658290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:11.659464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.660951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.662207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:11.662207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.662207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:11.756623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:11.757038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:11.757860 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.758302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.759724 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:11.761545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.762491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:11.765104 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.766455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:11.767520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.768230 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.769061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:11.769434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:16.444371 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:16.500425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:16.534403 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.534630 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.535386 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.536075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.537216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:16.611109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:16.612589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.613032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.613476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.614638 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:16.616370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.617346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:16.653570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:16.653902 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:16.654322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.654541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.655137 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:16.655930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.656435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:16.656963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.657442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.657968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:16.657968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.657968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:16.757212 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:16.757743 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:16.758324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.758784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.759555 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:16.760950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.761414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:16.762893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.763420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:16.763913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.763913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:16.766515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:16.767144 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:16.767977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.768410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:16.768641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.769458 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.770618 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:16.771152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:21.499708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:21.500989 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:21.536580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.536912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.538262 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.539544 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.540134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:21.611750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:21.613660 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.614149 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.614795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.615965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:21.618076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.618879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:21.654479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:21.655015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:21.655315 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.655715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.656151 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:21.657882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:21.658884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.659381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.659912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:21.757757 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:21.758240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:21.759253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.760792 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:21.761958 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:21.763315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.764001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.764887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:21.767164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:21.768251 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:21.768882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.769228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:21.769525 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.770770 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.772887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:21.773660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:26.500430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:26.502315 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:26.536058 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.537527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:26.592177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:26.592720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.593705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:26.612463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:26.614133 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.614512 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.614931 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.616404 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:26.618461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.618828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:26.655028 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:26.655953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:26.656905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.657322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.658196 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:26.659137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.659680 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:26.660189 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.660716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.661256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:26.661256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.661256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:26.758727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:26.759106 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:26.760141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.760623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.761761 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:26.763077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.764047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:26.764482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.765187 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:26.765806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.765806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:26.767622 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:26.768439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:26.768834 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.769163 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:26.769364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.769989 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.771843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:26.772426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:31.501103 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:31.502614 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:31.530900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.531170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.531982 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.533112 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.533748 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:31.613076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:31.614154 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.614435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.614700 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.615480 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:31.617059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.617899 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:31.655650 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:31.656119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:31.656644 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.656953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.657881 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:31.659481 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.660191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:31.661250 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.662119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.663085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:31.663085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.663085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:31.759262 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:31.759582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:31.759772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.759944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.760361 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:31.761728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:31.762913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.763820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.764803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:31.767969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:31.768228 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:31.768676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.768676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:31.768801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.769232 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.770178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:31.771084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:36.501589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:36.502401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:36.544098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.544351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.544898 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.545935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.547002 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:36.613659 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:36.614298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.614453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.614562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.614996 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:36.615844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.616918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.699010 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:36.701092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:36.702393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.703171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.704625 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:36.759991 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:36.760438 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:36.761084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.761650 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.762886 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:36.764280 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.764831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:36.766398 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.767063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:36.767859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.767859 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:36.768617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:36.768996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:36.769374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.769592 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:36.769740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.770197 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.771126 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:36.771753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:41.502005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:41.503440 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:41.505925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:23:41.538623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.538868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.539415 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.540328 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.541167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:41.614701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:41.615788 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.615932 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.616039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.616522 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:41.617367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.618013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:41.695400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:41.696387 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:41.764849 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.765009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.766261 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:41.766994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:41.767524 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:41.768051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.768500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.768921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:41.768921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.768921 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:41.768921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:41.768921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.769924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:41.769924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.769924 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.770452 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:41.770972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.771378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:41.772161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.772895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:41.775191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:46.502680 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:46.503666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:46.540567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.540840 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.541596 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.542866 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.543363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:46.615410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:46.616732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.616975 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.617157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.619411 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:46.621479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.622244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:46.696443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:46.697138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:46.697765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.698101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.698889 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:46.699907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.700624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:46.701121 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.702095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.702617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:46.702617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.702617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:46.768714 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:46.769222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:46.769637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:46.770182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:46.770763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.771226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.772286 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:46.773956 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.807198 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.807957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:46.809827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.812072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:46.813484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:46.815038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:51.503454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:51.505326 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:51.535675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.535949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.536659 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.537783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.538799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:51.616439 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:51.617384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.617561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.617713 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.618687 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:51.621415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.622058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:51.697384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:51.698176 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:51.698895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.699215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.700232 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:51.701890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.703094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:51.704448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.705376 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.706215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:51.706215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.706215 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:51.769560 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:51.770186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:51.770753 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:51.771572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:51.771994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.772500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.773463 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:51.774434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.774860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:51.776070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.776626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:51.777284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.777284 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:51.777284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.777284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:51.777476 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.778201 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.780374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:51.780907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:56.504175 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:56.505899 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:56.542298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.542673 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.543674 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.544913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.545753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:56.617022 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:56.618260 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.618585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.618809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.619723 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:56.620807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.621672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:56.698194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:56.698811 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:23:56.699547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.699912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.700862 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:56.702406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.703435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:23:56.704308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.705095 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.705969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:56.705969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.705969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:56.770303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:56.770786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:56.771570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.772871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:23:56.773146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.774282 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.774622 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:23:56.776080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:23:56.776516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:23:56.778254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.778710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:56.779193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.779193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:23:56.779193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:23:56.779193 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.779361 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.780578 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:23:56.781044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:01.504898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:01.506502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:01.544427 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.544704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.545375 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.546300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.546870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:01.617684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:01.618985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.619654 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.620167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.621119 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:01.622898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.623429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:01.698895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:01.699575 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:01.700237 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.700694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.701794 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:01.703417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.704304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:01.705127 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.705874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.706754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:01.706754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.706754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:01.770821 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:01.771392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:01.772047 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.772517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.773505 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:01.775109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:01.775865 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:01.777679 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.778569 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:01.779240 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.780039 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.781730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:01.782283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:06.505546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:06.506564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:06.536613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.537199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.538088 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.539222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.540146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:06.618391 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:06.619698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.620037 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.620295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.621352 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:06.623136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.623844 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:06.699487 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:06.700155 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:06.701032 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.701387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.702373 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:06.703719 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.704492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:06.705347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.706223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.707024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:06.707024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.707024 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:06.771252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:06.771733 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:06.772226 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.772663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.773435 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:06.773983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:06.775017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.775908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:06.776810 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:06.777513 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:06.778051 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.778538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:06.778850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.779707 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.781577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:06.782012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:11.506313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:11.508252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:11.549012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.549466 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.550367 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.551881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.552385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:11.619122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:11.620600 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.620933 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.621213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.622421 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:11.624467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.625532 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:11.700218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:11.700703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:11.701430 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.701740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.702633 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:11.703970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.704797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:11.705564 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.706351 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.707184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:11.707184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.707184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:11.772028 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:11.772585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:11.773421 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.773823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.774701 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:11.776090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.776545 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:11.777795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.778244 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:11.778755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.778755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:11.778755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:11.778755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:11.779045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.779508 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:11.779753 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.780451 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.781512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:11.781981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:16.506974 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:16.508703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:16.546882 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.546882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.547626 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.549516 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.550803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:16.619977 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:16.621512 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.621724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.621912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.622751 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:16.624053 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.624900 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:16.700945 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:16.701552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:16.702253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.702607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.703472 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:16.704692 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.705507 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:16.706654 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.707496 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.708464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:16.708464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.708464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:16.772520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:16.773040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:16.773624 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.774028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.774766 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:16.775874 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.776568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:16.777720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.778491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:16.779295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.779295 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:16.779295 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:16.779295 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:16.779831 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.780164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:16.780425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.781142 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.783047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:16.783576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:21.507740 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:21.509192 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:21.549909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.550349 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.551369 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.553055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.553971 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:21.620832 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:21.621916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.622214 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.622499 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.623363 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:21.624761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.625371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:21.701719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:21.702173 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:21.702643 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.702898 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.703809 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:21.705236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.706042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:21.706517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.707267 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.708109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:21.708109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.708109 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:21.773161 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:21.773746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:21.774389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.774849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.775667 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:21.776895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.777597 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:21.778863 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.779641 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:21.780479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.781157 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.782704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:21.783512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:26.508697 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:26.510375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:26.543490 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.543762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.544364 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.545181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.546238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:26.621564 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:26.622946 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.623316 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.623586 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.624620 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:26.626633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.627138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:26.702247 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:26.702840 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:26.703747 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.704156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.705382 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:26.706827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.707377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:26.708894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.709482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.711617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:26.711617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.711617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:26.774097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:26.774613 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:26.775394 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.775821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.776878 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:26.777862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.778772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:26.779159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.780009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:26.780930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.781419 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.782285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:26.783063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:31.509319 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:31.510222 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:31.544616 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.544890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.545615 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.546433 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.547045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:31.622238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:31.623585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.623970 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.624291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.625131 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:31.626323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.626626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:31.702765 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:31.703343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:31.703890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.704705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.704841 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:31.706097 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.706806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:31.707734 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.708559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.709474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:31.709474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.709474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:31.774815 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:31.775585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:31.776467 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.776906 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.777901 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:31.779429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.780210 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:31.781795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.782661 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:31.783550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.783550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:31.783550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:31.783550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:31.783550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.783827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:31.783827 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.784693 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.785975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:31.786449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:36.509926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:36.511699 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:36.546012 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.546383 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.547192 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.548156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.548757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:36.622830 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:36.624192 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.624538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.624775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.625769 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:36.627527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.628432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:36.703240 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:36.703828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:36.704534 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.704829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.705752 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:36.707093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:36.708781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.709582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.710459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:36.710459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.710459 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:36.775395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:36.775979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:36.776688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.776972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.777662 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:36.778619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.779325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:36.780044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.780611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:36.781108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.781108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:36.782523 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:36.783096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:36.783910 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.783910 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:36.784446 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.785080 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.786987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:36.787791 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:41.510676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:41.512580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:41.514308 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:24:41.543742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.544214 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.545047 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.545881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.546674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:41.623553 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:41.624898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.625372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.625626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.626762 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:41.628754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.629090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:41.703939 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:41.704458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:41.705114 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.705470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.706408 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:41.707801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.708530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:41.709504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.710550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.711414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:41.711414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.711414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:41.776087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:41.776651 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:41.777494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.777887 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.778750 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:41.780047 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.780760 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:41.781967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.782853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.783750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:41.784129 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.784430 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.785439 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:41.786246 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:46.511550 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:46.512929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:46.549079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.549368 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.550057 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.551194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.552086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:46.624220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:46.625707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.626077 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.626387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.627415 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:46.628722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.629568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:46.704668 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:46.705141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:46.705796 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.706115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.706981 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:46.708348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.709150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:46.709932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.710686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.711529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:46.711529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.711529 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:46.776690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:46.777205 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:46.778109 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.778538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.779360 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:46.780672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.781479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:46.782294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.783091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:46.783994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.783994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:46.783994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:46.783994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:46.784335 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.784746 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:46.785066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.785663 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.786954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:46.787456 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:51.512357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:51.513422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:51.543389 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.543640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.544350 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.545463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.546416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:51.625081 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:51.626181 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.627073 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.627073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.627755 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:51.628913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.629483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:51.705579 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:51.706544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:51.707095 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.707425 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.708222 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:51.709714 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.710670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:51.711115 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.711873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.712660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:51.712660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.712660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:51.777457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:51.777996 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:51.778596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.778934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.779796 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:51.780959 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.781686 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:51.782092 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.782803 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:51.783820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.783820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:51.783926 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:51.784701 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:51.785097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.785454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:51.785669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.786441 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.788730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:51.789207 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:56.512922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:56.514628 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:56.551783 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.552395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.553436 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.554573 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.555537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:56.625792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:56.626953 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.627285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.627562 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.628764 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:56.630607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.631493 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:56.706196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:56.706925 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:24:56.707653 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.708058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.708985 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:56.710523 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.711724 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:24:56.712794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.713744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.714290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:56.714290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.714290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:56.778135 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:56.778707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:56.779444 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.780042 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.780842 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:24:56.782316 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.783211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:24:56.783961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.785054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:56.786325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.786325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:24:56.786325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:24:56.786325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:24:56.786325 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.786767 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:24:56.786868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.787716 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.789919 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:24:56.790457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:01.513599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:01.515256 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:01.551947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.552172 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.553000 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.554238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.554825 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:01.626547 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:01.627682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.628122 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.628408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.631118 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:01.633229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.634122 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:01.706758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:01.707243 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:01.707889 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.708145 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.708850 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:01.710089 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.710745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:01.711559 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.712081 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.712725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:01.712725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.712725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:01.778828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:01.779562 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:01.780199 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.780531 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.781234 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:01.782602 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.783557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:01.784247 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.785155 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.786313 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:01.786664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.787005 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.788304 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:01.788949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:06.514366 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:06.516038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:06.550911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.551426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.552292 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.553238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.554070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:06.627029 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:06.628299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.628675 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.628916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.629918 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:06.631723 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.632442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:06.707327 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:06.707730 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:06.708287 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.708637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.709457 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:06.710720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.711395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:06.712286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.712976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.713831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:06.713831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.713831 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:06.779420 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:06.779895 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:06.780458 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.780822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.781619 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:06.782911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.783414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:06.784553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.785000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:06.785510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.785510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:06.785510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:06.786537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:06.787066 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.787435 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:06.787656 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.788441 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.789852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:06.790354 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:11.515070 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:11.516661 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:11.551026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.551455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.552331 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.553293 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.554460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:11.629914 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:11.631329 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.631571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.631811 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.632730 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:11.634066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.634561 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:11.707720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:11.708128 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:11.708952 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.709286 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.710158 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:11.711601 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.712407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:11.712909 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.713948 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.714890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:11.714890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.714890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:11.780078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:11.780401 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:11.781019 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.781526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.782505 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:11.783281 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.783726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:11.784364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.784855 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:11.785463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.785463 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:11.786143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:11.786610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:11.787043 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.787412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:11.787696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.788460 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.790156 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:11.790772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:16.549057 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:16.550023 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:16.581426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.581924 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.583013 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.583933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.584822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:16.630580 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:16.631853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.632209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.632485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.633438 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:16.635196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.635688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:16.708395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:16.708859 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:16.709467 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.709809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.710726 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:16.712150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.712917 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:16.714057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.715063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.716051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:16.716051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.716051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:16.780517 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:16.781152 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:16.781828 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.782296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.783179 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:16.784520 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.785225 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:16.786194 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.787134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.788039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:16.788488 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.788918 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.790649 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:16.791539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:21.613777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:21.613777 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:21.631441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:21.634634 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.635571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.635901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.636950 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:21.640088 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.640804 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:21.653174 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.653468 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.653949 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.654995 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.655886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:21.709115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:21.709911 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:21.710662 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.710918 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.711735 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:21.713072 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.714116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:21.714884 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.716030 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.717470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:21.717470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.717470 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:21.781201 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:21.781918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:21.782814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.783285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.784424 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:21.785839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.786908 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:21.787462 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.788262 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:21.789185 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.789709 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.791243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:21.791780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:26.550397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:26.551567 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:26.588031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.588504 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.589508 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.591674 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.592729 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:26.664556 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:26.665566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.665710 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.665828 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.666384 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:26.667224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.667660 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:26.709857 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:26.710119 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:26.710683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.710994 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.711940 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:26.712637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.712983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:26.713382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.713772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.714138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:26.714138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.714138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:26.781904 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:26.782641 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:26.783725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.784179 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.785336 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:26.786637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.786975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:26.788096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.788590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:26.789138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.789138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:26.789138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:26.789138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:26.789348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.789542 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:26.789687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.790161 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.791031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:26.791621 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:31.551373 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:31.552868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:31.585741 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.585962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.586599 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.587577 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.588406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:31.664871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:31.666143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.666476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.666746 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.668364 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:31.669346 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.670148 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:31.710503 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:31.711025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:31.711593 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.711916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.712820 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:31.714018 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.714856 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:31.715379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.716441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.717491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:31.717491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.717491 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:31.782577 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:31.783272 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:31.783862 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.784455 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.785392 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:31.786932 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.787836 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:31.788255 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.789044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:31.789883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.789883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:31.789883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:31.789883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:31.790087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.790369 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:31.790498 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.791170 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.792914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:31.793419 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:36.551929 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:36.554000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:36.589395 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.589990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.590873 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.592093 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.593348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:36.666418 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:36.667758 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.668134 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.668412 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.669393 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:36.671204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.672086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:36.732532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:36.733732 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:36.734486 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.735202 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.735911 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:36.737484 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.738212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:36.739367 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.740297 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.741057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:36.741057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.741057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:36.783646 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:36.784707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:36.785087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.785291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.786356 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:36.787934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.788438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:36.790212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.791174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.792177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.792720 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.795034 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:36.795745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:40.843631 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:40.853129 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Apr 02 06:25:40.853337 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=104358) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:367}}
Apr 02 06:25:40.853426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:40.885823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0552b30f-5ca8-46d7-8291-6694737449be, resource={'id': '0552b30f-5ca8-46d7-8291-6694737449be', 'name': 'private', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0b95871b-d043-4e3f-83e1-eeb5f42fa684', '5fd47a51-7454-4f90-ac08-576fe41aeef8'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:50:26Z', 'updated_at': '2026-04-02T05:50:30Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 7388}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.886170 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0552b30f-5ca8-46d7-8291-6694737449be, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.886621 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-a52fb248-e6ff-4e84-b66e-6cff01b5c08d, external_ids_update=None, columns={'tag': 7388}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.886762 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.887925 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource 0552b30f-5ca8-46d7-8291-6694737449be (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.889009 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.889693 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.890448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:40.890448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.890448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:40.890448 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:40.917617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, resource={'id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'name': 'public', 'tenant_id': 'c813ab5e30c841af8930d89d17be307c', 'project_id': 'c813ab5e30c841af8930d89d17be307c', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['2286103c-a900-4a67-809a-37dde95548ca', '31efb44e-b2fb-4b56-ae58-7bf942b92d85'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-04-02T05:50:33Z', 'updated_at': '2026-04-02T05:50:41Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.918367 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.919031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-709ccde1-cd6a-48f6-9f17-ee75c4c1e73b, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.919407 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.920381 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource e65e2f8d-cb2e-470d-9477-b2507860d7eb (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.921394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.921935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.922705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:40.922705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.922705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:40.922705 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:40.949617 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, resource={'id': '0d471cb6-d079-4b1a-a962-fbf5890bf386', 'name': 'admin_net', 'tenant_id': '5b441382f723484393ee898ee658d031', 'project_id': '5b441382f723484393ee898ee658d031', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['e2297803-5f9d-4740-adab-e3bbb55addac'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:54:44Z', 'updated_at': '2026-04-02T05:54:45Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 17306}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.950007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-0d471cb6-d079-4b1a-a962-fbf5890bf386, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.950541 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-6525fcc1-c829-4cff-a8b7-53ad0e498fa5, external_ids_update=None, columns={'tag': 17306}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.950727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.951617 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource 0d471cb6-d079-4b1a-a962-fbf5890bf386 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.952696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.953146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.953527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:40.953527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.953527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:40.953527 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:40.984633 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-335e4deb-892f-481a-a955-819809a93d31, resource={'id': '335e4deb-892f-481a-a955-819809a93d31', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['f1d623ed-643b-49fc-a8e7-17b0be4cfdfd'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-04-02T05:55:21Z', 'updated_at': '2026-04-02T05:55:22Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 25917}, resource_type=networks, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.984894 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-335e4deb-892f-481a-a955-819809a93d31, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.985211 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-c21b0d42-7cd9-44fa-9f7a-8e763cbe9c98, external_ids_update=None, columns={'tag': 25917}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:40.985345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.985907 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource 335e4deb-892f-481a-a955-819809a93d31 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.987022 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:40.987592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:40.988372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:40.988372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:40.988372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:40.988372 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:41.067195 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, resource={'id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'project_id': 'a4f20d22665647ae9a8ed456b8dd8b84', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'enable_snat': True}, 'gw_port_id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-66r9h', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'external_fixed_ips': [{'ip_address': '172.24.5.178', 'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca'}, {'ip_address': '2001:db8::13b', 'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-04-02T05:55:22Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 3, 'tenant_id': 'a4f20d22665647ae9a8ed456b8dd8b84'}, resource_type=routers, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.067503 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-66r9h', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.067708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.067850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "ab5c8b83-0627-4898-9f9e-e89ef9be6e27"')], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.068027 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.068744 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.068980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Unable to update router 2b020ce1-8813-4189-9cf5-2d327e28eec9. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource 2b020ce1-8813-4189-9cf5-2d327e28eec9 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Apr 02 06:25:41.070191 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:41.070658 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:41.071031 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Fixing resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports) at create/update {{(pid=104358) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:396}}
Apr 02 06:25:41.187698 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, resource={'id': 'ab5c8b83-0627-4898-9f9e-e89ef9be6e27', 'name': '', 'network_id': 'e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'project_id': '', 'mac_address': 'fa:16:3e:79:3f:92', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2b020ce1-8813-4189-9cf5-2d327e28eec9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': '2286103c-a900-4a67-809a-37dde95548ca', 'ip_address': '172.24.5.178'}, {'subnet_id': '31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'ip_address': '2001:db8::13b'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000162743', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-04-02T05:55:23Z', 'updated_at': '2026-04-02T05:55:25Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.188362 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': '2286103c-a900-4a67-809a-37dde95548ca 31efb44e-b2fb-4b56-ae58-7bf942b92d85', 'neutron:network_name': 'neutron-e65e2f8d-cb2e-470d-9477-b2507860d7eb', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::13b/64', '172.24.5.178/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.188467 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=ab5c8b83-0627-4898-9f9e-e89ef9be6e27, lrouter_port=lrp-ab5c8b83-0627-4898-9f9e-e89ef9be6e27, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.188914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Traceback (most recent call last):
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.189833 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Failed to fix resource ab5c8b83-0627-4898-9f9e-e89ef9be6e27 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 409, in check_for_inconsistencies
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 318, in _fix_create_update
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:41.191124 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.191697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.193201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Apr 02 06:25:41.193201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.193201 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Apr 02 06:25:41.193201 np0000162743 neutron-ovn-maintenance-worker[104358]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b695d351-ced8-489b-a488-a923ce587d8b None None] Maintenance task: Synchronization completed (took 0.34 seconds)
Apr 02 06:25:41.552822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:41.554594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:41.556465 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=434 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:25:41.595856 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.596314 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.597730 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.599681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.600731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:41.667153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:41.668960 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.669375 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.669588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.670374 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:41.672076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.672581 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:41.733738 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:41.734585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:41.735118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.735511 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.736377 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:41.737941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.738773 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:41.739252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.740389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.741229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:41.741229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.741229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:41.784519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:41.784999 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:41.785533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.785843 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.786546 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:41.788064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.788394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:41.789869 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.790780 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:41.791683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.791683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:41.791683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:41.791683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:41.791683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.791983 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:41.792051 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.792813 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.794519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:41.795330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:46.553761 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:46.554711 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:46.584426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.584588 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.585001 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.585779 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.586784 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:46.667867 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:46.669298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.669681 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.670934 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Traceback (most recent call last):
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.671926 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0ac5d555-4194-474a-8cb0-4445bcb3d5dd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:46.673196 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.673979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:46.734568 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:46.735115 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:46.735707 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.736021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.736829 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:46.737534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:46.738324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.739046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.739875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:46.850303 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:46.850881 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:46.851183 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:46.851791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:46.852808 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.853537 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.854334 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.854816 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:46.854974 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.856427 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.856986 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:46.858852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.859423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:46.860607 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.861343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:46.861976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.861976 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.862063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:46.862667 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:51.554463 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:51.556143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:51.596558 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.596761 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.597323 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.598453 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.599411 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:51.668492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:51.669817 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.670123 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.670424 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.671324 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:51.673467 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.674478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:51.735443 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:51.735918 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:51.736484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.736935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.737829 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:51.739195 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.739688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:51.741142 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.741604 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.742106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:51.742106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.742106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:51.851384 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:51.852078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:51.852502 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:51.853125 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.853740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.854608 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:51.856644 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:51.857594 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:51.858894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.859432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:51.859969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.859969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:51.859969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.859969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:51.859969 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.860727 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.862430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:51.863045 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:56.555186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:56.556909 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:56.593168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.593757 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.594682 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.595619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.596653 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:56.669241 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:56.670554 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.670940 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.671254 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.672457 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:56.674309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.675236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:56.736294 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:56.736735 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:25:56.737750 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.738114 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Traceback (most recent call last):
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.739111 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:56.740695 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.741212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e727d9ad-1c4b-4153-a1d2-6a9be1deb238 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:25:56.742423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.742878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.743387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:56.743387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.743387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:56.852185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:56.852756 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:56.853535 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.854043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.854913 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:25:56.855941 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.856478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:25:56.857063 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.857629 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.858164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:25:56.858400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.858789 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.859770 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:25:56.860306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:01.556112 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:01.557846 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:01.588835 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.589253 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.590134 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.591052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.592139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:01.670145 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:01.671537 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.671788 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.672110 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.672882 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:01.674611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.675438 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:01.736969 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:01.738030 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:01.738719 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.738979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.739886 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:01.741395 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.742606 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:01.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.744539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.745556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:01.745556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.745556 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:01.852655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:01.853289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:01.854252 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.854575 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.855464 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:01.856774 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.857245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:01.858672 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.859151 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:01.859742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.859742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:01.859742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:01.859742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:01.860130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.860360 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:01.860474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.861080 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.862643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:01.863176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:06.556785 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:06.558494 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:06.592532 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.592914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.593739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.594697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.595608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:06.670739 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:06.672054 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.672454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.672690 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.673829 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:06.675883 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.676728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:06.737611 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:06.738097 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:06.738776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.739087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.739876 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:06.741107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.741647 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:06.742669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.743204 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.743742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:06.743742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.743742 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:06.853242 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:06.854011 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:06.854672 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.855029 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.855902 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:06.857558 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.858812 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:06.860000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.861181 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:06.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:06.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:06.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:06.862482 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.862901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:06.862901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.863823 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.865213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:06.865794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:11.557570 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:11.559159 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:11.600551 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.600783 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.601291 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.602096 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.602986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:11.671408 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:11.672566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.672720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.672970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.673500 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:11.675256 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.676350 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:11.738118 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:11.738610 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:11.739239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.739635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.740474 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:11.741410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:11.742557 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.743599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.744871 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:11.853866 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:11.854759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:11.855703 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.856163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.857434 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:11.859141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.860294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:11.860897 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.862039 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.863169 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:11.863738 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.864418 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.866241 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:11.867169 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:16.558224 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:16.559432 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:16.595471 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.595845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.596833 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.597905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.599075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:16.672263 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:16.673437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.673890 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.674445 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.675306 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:16.676471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.677118 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:16.738736 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:16.739196 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:16.739905 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.740408 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Traceback (most recent call last):
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.741394 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:16.742343 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.742875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-0b8ac63f-3a26-4145-a719-939f71f7f681 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:16.743444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.743929 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.744502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:16.744502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.744502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:16.854497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:16.855015 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:16.855812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.856289 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.857232 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:16.858841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.859936 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:16.860766 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.861818 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:16.862986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.862986 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:16.862986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:16.862986 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:16.863354 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.863552 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:16.863802 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.864858 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.866951 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:16.867628 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:21.558927 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:21.561301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:21.598608 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.599249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.600236 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.601378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.602619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:21.672863 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:21.674234 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.674655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.675085 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.676299 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:21.678116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.679167 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:21.739304 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:21.739861 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:21.740786 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.741120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.742007 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:21.743533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.744186 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:21.745066 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.745792 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.746599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:21.746599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.746599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:21.855329 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:21.856001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:21.856764 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.857224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.861315 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.862205 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:21.863132 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.863901 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:21.865235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.865235 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:21.865666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:21.866036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:21.866582 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.866883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:21.867068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.867624 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.868737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:21.869057 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:26.559589 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:26.561007 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:26.598718 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.599390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.600229 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.601478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.602390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:26.673516 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:26.674682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.675042 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.675147 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.676019 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:26.677669 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.678546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:26.739847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:26.740462 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:26.741121 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.741477 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.742372 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:26.743764 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.744550 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:26.745382 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.746211 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.747131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:26.747131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.747131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:26.856209 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:26.856850 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:26.857737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.858261 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.859371 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:26.860704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.861961 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:26.862745 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.863992 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:26.865416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.865416 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:26.866299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:26.866791 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:26.867307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.867479 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:26.867643 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Traceback (most recent call last):
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.868432 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-83a7310f-fd0f-4e33-a02e-fc8ccf135318 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.870638 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:26.871358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:31.560410 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:31.561772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:31.597723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.598967 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.599848 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.600801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.601310 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:31.674060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:31.675499 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.675822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.675822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.676870 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:31.679021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.681073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:31.740571 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:31.741253 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:31.741842 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.742138 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.742891 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:31.744461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.745059 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:31.746378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.747568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.748838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:31.748838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.748838 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:31.857004 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:31.857688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:31.858138 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.858441 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.859049 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:31.859893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.860954 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:31.861332 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.862718 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:31.863678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.863678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:31.866792 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:31.867794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:31.868284 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.868572 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:31.868722 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.869380 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.871146 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:31.871622 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:36.560951 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:36.562623 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:36.595980 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.596758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.598105 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.599283 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.599776 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:36.674826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:36.676116 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.676476 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.676704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.677637 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:36.679508 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.680391 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:36.741519 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:36.742127 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:36.742645 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.743465 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.743702 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:36.744417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.745171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:36.745737 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.746541 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.747464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:36.747464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.747464 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:36.857921 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:36.858643 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:36.859411 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.859942 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.860705 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:36.862514 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.863311 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:36.864285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.865031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:36.865709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.865709 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:36.867348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:36.868002 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:36.868450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.868684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:36.868832 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.869530 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.871435 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:36.871973 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:41.561727 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:41.563870 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:41.566307 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:26:41.599364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.599807 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.601242 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.602130 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.603497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:41.675625 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:41.676425 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.676655 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.676851 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.677420 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:41.678703 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.679213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:41.742060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:41.742716 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:41.743298 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.743515 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.744245 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:41.745689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.746595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:41.747473 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.748325 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.749296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:41.749296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.749296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:41.858588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:41.859285 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:41.860060 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.860506 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.861393 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:41.862816 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.863631 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:41.864704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.865890 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:41.866998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.866998 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:41.867999 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:41.868464 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:41.868693 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.868896 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:41.869046 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.869517 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.870539 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:41.871079 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:46.562453 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:46.564113 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:46.604585 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.605068 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.606184 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.607417 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.608200 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:46.676230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:46.677520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.678036 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.678036 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.678878 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:46.680608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.681448 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:46.742676 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:46.743413 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:46.744099 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.744432 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.745131 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:46.746101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.746790 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:46.747199 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.747915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.748732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:46.748732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.748732 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:46.859497 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:46.859903 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:46.860720 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.861123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.862125 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:46.864249 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.864915 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:46.866294 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.867375 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:46.868234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.868234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:46.868397 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:46.869021 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:46.869450 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.869823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:46.870075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.871136 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.873020 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:46.873914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:51.563025 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:51.564343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:51.596604 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.597086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.598159 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.599608 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.601077 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:51.676998 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:51.678649 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.679079 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.679704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.680758 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:51.684113 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.685231 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:51.743212 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:51.743900 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:51.744495 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.744750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.745443 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:51.746492 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.747361 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:51.748150 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.748984 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.749885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:51.749885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.749885 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:51.860164 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:51.860538 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:51.861186 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.861640 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.862933 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:51.864632 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.865427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:51.866449 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.867444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:51.868447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.868447 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:51.868807 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:51.869615 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:51.869967 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.870182 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:51.870358 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.871012 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.872913 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:51.873595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:56.563771 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:56.565132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:56.599597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.600238 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.601410 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.602372 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.603406 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:56.677682 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:56.678976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.679289 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.679614 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.680546 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:56.682320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.683103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:56.743876 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:56.744193 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:26:56.744958 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.745162 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.745805 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:56.746758 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:26:56.747817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.748400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.748968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:56.748968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.748968 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:56.860827 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:56.861423 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:56.862245 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.862728 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.863670 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:26:56.864985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.865696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:26:56.866880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.867527 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:56.868099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.868099 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:26:56.869356 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:26:56.869726 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:26:56.870096 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.870480 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:26:56.870683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.871688 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.873461 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:26:56.873985 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:01.564651 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:01.566343 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:01.597318 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.597789 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.598736 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.599801 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.600696 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:01.678509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:01.680143 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.680442 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.680620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.681616 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:01.683048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.683878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:01.744525 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:01.745210 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:01.746218 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.746689 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.747677 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:01.749141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.749681 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:01.750972 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.751478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.752026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:01.752026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.752026 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:01.861754 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:01.862522 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:01.863399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.863870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.864755 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:01.865725 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.866620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:01.867056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.867975 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:01.869149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.869149 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:01.869708 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:01.870540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:01.870883 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.871084 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:01.871229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.871891 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.873960 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:01.875160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:06.565555 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:06.567000 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:06.598688 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.599223 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.600158 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.601052 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.601657 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:06.679075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:06.680238 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.680520 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.680720 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.681430 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:06.682324 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.683666 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:06.745009 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:06.745540 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:06.746236 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.746609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.747426 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:06.748410 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:06.749501 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.750226 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.751100 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:06.862543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:06.863406 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:06.864299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.864775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.865687 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:06.867108 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.867944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:06.869229 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.870659 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:06.871533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.871533 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:06.871533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:06.871533 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:06.871836 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.872076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:06.872309 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.872982 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.874168 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:06.874983 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:11.566379 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:11.568374 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:11.606069 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.606512 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.607337 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.608553 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.608996 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:11.679819 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:11.681142 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.681491 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.681794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.682860 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:11.684576 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.685107 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:11.745723 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:11.746365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:11.747039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.747389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.748234 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:11.749750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.750623 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:11.751503 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.752442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.753335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:11.753335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.753335 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:11.863405 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:11.863931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:11.864641 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.865040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.865845 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:11.867038 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.867809 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:11.868891 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.869678 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:11.870822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.870822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:11.870822 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:11.871087 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:11.871823 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.872244 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:11.872565 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.873370 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.874322 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:11.874805 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:16.566995 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:16.569064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:16.603724 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.604139 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.605076 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.605957 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.606799 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:16.680501 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:16.681947 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.682230 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.682534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.683478 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:16.685292 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.685767 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:16.746380 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:16.746923 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:16.747725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.748074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.749044 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:16.750106 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.751166 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:16.752300 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.753048 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.753582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:16.753582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.753582 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:16.864040 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:16.864728 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:16.865588 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.866070 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.867017 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:16.868497 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.869326 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:16.870125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.870896 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:16.871772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.871772 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:16.871772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:16.871772 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:16.872157 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.872332 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:16.872509 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.873302 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.875086 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:16.876365 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:21.567759 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:21.569440 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:21.606345 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.606345 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.606694 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.608400 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.608965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:21.681132 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:21.682399 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.682683 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.683065 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.684015 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:21.685595 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.686444 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:21.747492 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:21.747725 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:21.748192 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.748414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.749043 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:21.750390 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.751474 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:21.751963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.752853 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.753485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:21.753485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.753485 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:21.864874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:21.865290 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:21.865763 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.866125 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.866868 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:21.868044 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.868795 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:21.869922 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.870756 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:21.871587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.871587 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:21.871679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:21.872402 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:21.872838 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.873353 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:21.873589 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.874405 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.876203 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:21.876740 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:26.568322 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:26.569454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:26.599679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.600177 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.601591 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.603000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.603849 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:26.681994 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:26.683737 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.684045 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.684362 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.685526 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:26.687054 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.687611 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:26.747794 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:26.748365 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:26.749400 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.749793 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.751004 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:26.752590 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.753243 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:26.754216 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.754980 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.755820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:26.755820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.755820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:26.865976 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:26.866812 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:26.867814 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.868857 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.870423 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:26.871878 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.872775 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:26.873902 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.874768 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:26.876001 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.876964 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.878090 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:26.878839 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:31.568853 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:31.570638 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:31.613038 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.613330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.614015 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.614916 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.615835 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:31.682826 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:31.684078 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.684546 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.684933 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.685895 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:31.687091 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.687513 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:31.748426 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:31.749039 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:31.749684 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.750000 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.751043 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:31.752344 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.753058 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:31.753930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.754710 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.755572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:31.755572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.755572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:31.866637 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:31.867194 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:31.867874 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.868152 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.868926 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:31.870895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.872023 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:31.873624 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.874566 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:31.875596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.875596 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:31.875596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:31.875596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:31.875596 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.876061 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:31.876061 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.876879 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.878528 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:31.879004 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:36.569667 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:36.570916 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:36.601082 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.601858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.602894 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.604075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.605082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:36.683357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:36.684766 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.685160 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.685652 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.686750 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:36.687965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.688626 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:36.748912 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:36.749599 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:36.750404 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.750754 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.751668 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:36.753160 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.753842 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:36.754858 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.755568 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.756450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:36.756450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.756450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:36.867484 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:36.868071 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:36.868855 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.869123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.869875 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:36.871290 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.872084 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:36.873035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.873907 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:36.874861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.874861 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:36.875062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:36.875776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:36.876847 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.877868 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:36.878781 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.879414 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.880619 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:36.881592 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:41.570348 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:41.572140 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:41.574457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG dbcounter [-] [104358] Writing DB stats neutron:SELECT=240 {{(pid=104358) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Apr 02 06:27:41.608901 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.609296 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.610176 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.611171 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.612087 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:41.683962 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:41.685364 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.685734 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.685987 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.687056 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:41.689074 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.689599 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:41.749515 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:41.749871 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:41.750412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.750749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.751620 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:41.752510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.753330 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:41.753786 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.754534 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.755387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:41.755387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.755387 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:41.867959 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:41.868470 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:41.869067 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.869483 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.870305 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:41.871517 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.872348 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:41.873206 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.874055 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:41.874944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.874944 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:41.875509 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:41.876412 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:41.876931 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.877357 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:41.877609 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.878427 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.879519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:41.880141 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:46.571239 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:46.573168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:46.602566 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.602945 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.603872 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.604914 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.605683 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:46.684679 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:46.686090 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.686457 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.686687 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.687739 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:46.689949 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.691064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:46.750311 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:46.750888 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:46.751618 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.752017 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.753064 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:46.754510 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.754930 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:46.756213 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.756707 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.757212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:46.757212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.757212 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:46.868648 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:46.869064 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:46.869670 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.870180 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.870965 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:46.872120 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.872797 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:46.873912 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.874356 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:46.874821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.874821 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:46.875934 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:46.876396 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:46.876755 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.877089 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:46.877429 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.878163 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.879741 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:46.880217 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:51.571964 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:51.573026 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:51.608437 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.608648 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.609489 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.610671 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.611862 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:51.685543 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:51.686769 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.687014 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.687178 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.687928 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:51.689116 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.689999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:51.751076 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:51.751536 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:51.752299 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.752749 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.753806 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:51.755103 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.756252 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:51.756822 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.757633 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.758519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:51.758519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.758519 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:51.869381 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:51.869968 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:51.870441 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.870715 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.871418 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:51.872841 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.873697 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:51.875031 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.876012 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:51.877075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.877075 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:51.877075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:51.877075 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:51.877561 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.877985 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:51.878176 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.878997 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.880877 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:51.881450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:56.572666 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:56.574168 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:56.611979 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.612442 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.613397 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.614549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.615471 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:56.686185 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:56.687392 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.687742 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.688082 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.688928 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:56.690870 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.692174 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:56.751674 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:56.752098 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:27:56.752685 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.752979 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.753817 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:56.755308 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.756040 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:27:56.757021 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.757894 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.758895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:56.758895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.758895 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:56.870180 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:56.870803 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:56.871595 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.871990 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.872852 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:27:56.874224 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.874963 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:27:56.875970 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.876684 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:56.877664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.877664 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:27:56.877664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:27:56.877664 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:27:56.878153 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.878557 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:27:56.878794 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.879572 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.881041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:27:56.881905 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:01.573296 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:01.574544 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:01.619324 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.619881 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.620962 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.622183 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.622763 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:01.686928 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:01.688062 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.688455 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.688711 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.689701 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:01.691563 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.692518 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:01.752198 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:01.752690 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:28:01.753422 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.754137 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.754826 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:28:01.756415 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.757101 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:28:01.757549 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.758393 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.759389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:01.759389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.759389 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:01.870749 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:01.871603 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:01.872642 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.873007 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.873999 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:28:01.875379 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.876123 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:28:01.877285 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.878094 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:01.878704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.878704 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:01.878704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:01.878704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:01.878704 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.878935 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:01.878935 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Traceback (most recent call last):
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.879378 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-010d6b1d-997a-4897-a56a-9644e1cb4c39 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.880347 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:01.880819 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:06.575220 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:06.578005 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:06.616130 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.616479 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Traceback (most recent call last):
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.617333 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-d5090b70-9835-4d9a-a0e6-aadaf95b2016 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 778, in check_fdb_aging_settings
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.618386 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.619035 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:06.687301 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:06.688500 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-9138e1c1-ce66-478a-856d-dca0afa5ba96, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.688839 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-2b020ce1-8813-4189-9cf5-2d327e28eec9, routes=[], if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.689073 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Traceback (most recent call last):
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.690041 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-8aef24c9-e04d-44a1-aa15-0d3b68a4fbe9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 870, in check_router_default_route_empty_dst_ip
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:06.692538 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.693646 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:06.752776 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:06.753597 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Setting fip-distributed flag in NB_Global to False {{(pid=104358) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1070}}
Apr 02 06:28:06.754086 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.754486 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Traceback (most recent call last):
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.755385 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:28:06.757005 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.757730 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-814ce143-35f8-4006-a6d5-ed817198b90b None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1074, in set_fip_distributed_flag
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Apr 02 06:28:06.758893 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                                                           ^^^^^^^^
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.759450 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.760028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:06.760028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.760028 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:06.883510 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:06.884770 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=104358) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Apr 02 06:28:06.885454 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:06.887898 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=104358) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Apr 02 06:28:06.888753 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.889237 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.890922 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.891141 np0000162743 neutron-ovn-maintenance-worker[104358]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=104358) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 02 06:28:06.891320 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Traceback (most recent call last):
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.891820 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Apr 02 06:28:06.892953 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.command 
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Traceback (most recent call last):
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]:     txn.results.put(txn.do_commit())
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]:                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]:     raise RuntimeError(msg)
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.893502 np0000162743 neutron-ovn-maintenance-worker[104358]: 
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-7d360f85-0e27-4a90-847f-a44fc0267003 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1129, in update_ha_failover
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Apr 02 06:28:06.897731 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.898333 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:06.898880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.898880 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics 
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics [None req-e464b1fe-883c-4b32-93d3-4819607200d5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics Traceback (most recent call last):
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     work()
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(*args, **kwargs)
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 792, in update_mac_aging_settings
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.899635 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     next(self.gen)
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     with self.create_transaction(
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     self.result = self.commit()
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise result.ex
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics     raise RuntimeError(msg)
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Apr 02 06:28:06.900157 np0000162743 neutron-ovn-maintenance-worker[104358]: ERROR futurist.periodics